-- Logs begin at Sat 2022-08-06 13:48:45 UTC, end at Sat 2022-08-06 14:56:57 UTC. -- Aug 06 14:21:38.738420 dv-cinder-851996-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 06 14:21:38.748706 dv-cinder-851996-4-iscsi devstack@n-api.service[103172]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 06 14:21:38.749244 dv-cinder-851996-4-iscsi devstack@n-api.service[103172]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Aug 6 14:21:38 2022] *** Aug 06 14:21:38.749244 dv-cinder-851996-4-iscsi devstack@n-api.service[103172]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 06 14:21:38.749244 dv-cinder-851996-4-iscsi devstack@n-api.service[103172]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 06 14:21:38.749244 dv-cinder-851996-4-iscsi devstack@n-api.service[103172]: nodename: dv-cinder-851996-4-iscsi Aug 06 14:21:38.749244 dv-cinder-851996-4-iscsi devstack@n-api.service[103172]: machine: x86_64 Aug 06 14:21:38.749244 dv-cinder-851996-4-iscsi devstack@n-api.service[103172]: clock source: unix Aug 06 14:21:38.749244 dv-cinder-851996-4-iscsi devstack@n-api.service[103172]: pcre jit disabled Aug 06 14:21:38.749244 dv-cinder-851996-4-iscsi devstack@n-api.service[103172]: detected number of CPU cores: 4 Aug 06 14:21:38.749244 dv-cinder-851996-4-iscsi devstack@n-api.service[103172]: current working directory: / Aug 06 14:21:38.749244 dv-cinder-851996-4-iscsi devstack@n-api.service[103172]: detected binary path: /usr/bin/uwsgi-core Aug 06 14:21:38.749244 dv-cinder-851996-4-iscsi devstack@n-api.service[103172]: your processes number limit is 47680 Aug 06 14:21:38.749244 dv-cinder-851996-4-iscsi devstack@n-api.service[103172]: your memory page size is 4096 bytes Aug 06 14:21:38.749244 dv-cinder-851996-4-iscsi devstack@n-api.service[103172]: detected max file descriptor number: 2048 Aug 06 14:21:38.749244 dv-cinder-851996-4-iscsi devstack@n-api.service[103172]: lock engine: pthread robust mutexes Aug 06 14:21:38.749999 dv-cinder-851996-4-iscsi devstack@n-api.service[103172]: thunder lock: enabled Aug 06 14:21:38.749999 dv-cinder-851996-4-iscsi devstack@n-api.service[103172]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 06 14:21:38.749999 dv-cinder-851996-4-iscsi devstack@n-api.service[103172]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 06 14:21:38.788955 dv-cinder-851996-4-iscsi devstack@n-api.service[103172]: Python main interpreter initialized at 0x55c9c9e709c0 Aug 06 14:21:38.788955 dv-cinder-851996-4-iscsi devstack@n-api.service[103172]: python threads support enabled Aug 06 14:21:38.788955 dv-cinder-851996-4-iscsi devstack@n-api.service[103172]: your server socket listen backlog is limited to 100 connections Aug 06 14:21:38.788955 dv-cinder-851996-4-iscsi devstack@n-api.service[103172]: your mercy for graceful operations on workers is 90 seconds Aug 06 14:21:38.789277 dv-cinder-851996-4-iscsi devstack@n-api.service[103172]: mapped 403077 bytes (393 KB) for 2 cores Aug 06 14:21:38.789352 dv-cinder-851996-4-iscsi devstack@n-api.service[103172]: *** Operational MODE: preforking *** Aug 06 14:21:38.789614 dv-cinder-851996-4-iscsi devstack@n-api.service[103172]: *** uWSGI is running in multiple interpreter mode *** Aug 06 14:21:38.789614 dv-cinder-851996-4-iscsi devstack@n-api.service[103172]: spawned uWSGI master process (pid: 103172) Aug 06 14:21:38.789796 dv-cinder-851996-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 06 14:21:38.791567 dv-cinder-851996-4-iscsi devstack@n-api.service[103172]: spawned uWSGI worker 1 (pid: 103173, cores: 1) Aug 06 14:21:38.791567 dv-cinder-851996-4-iscsi devstack@n-api.service[103172]: spawned uWSGI worker 2 (pid: 103174, cores: 1) Aug 06 14:21:38.791567 dv-cinder-851996-4-iscsi devstack@n-api.service[103172]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 06 14:21:39.441269 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 06 14:21:39.444354 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 06 14:21:40.524742 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 06 14:21:40.524742 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: from cryptography.utils import int_from_bytes Aug 06 14:21:40.525433 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 06 14:21:40.525433 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: from cryptography.utils import int_from_bytes Aug 06 14:21:40.527058 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 06 14:21:40.527058 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: from cryptography.utils import int_from_bytes Aug 06 14:21:40.527483 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 06 14:21:40.527483 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: from cryptography.utils import int_from_bytes Aug 06 14:21:42.989954 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 06 14:21:42.990588 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 06 14:21:42.990970 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 06 14:21:42.991097 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 06 14:21:42.991170 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 06 14:21:42.991250 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 06 14:21:42.991324 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 06 14:21:42.991392 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 06 14:21:42.991457 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 06 14:21:42.991533 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 06 14:21:42.991712 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:42.991857 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:42.991992 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:42.992184 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:42.992309 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:42.992507 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:42.992627 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:42.992829 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:42.992954 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:42.993163 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:42.993264 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:42.993470 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:42.993557 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:42.993787 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:42.993881 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:42.994108 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:42.994195 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:42.994420 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:42.994515 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:42.994691 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:42.994837 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:42.995030 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:42.995130 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851996-4-iscsi {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:42.995355 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851996-4-iscsi {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:42.995442 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:42.995657 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:42.995763 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:42.995963 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:42.996049 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:42.996272 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:42.996369 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:42.996574 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:42.996691 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:42.996886 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:42.996971 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:42.997184 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:42.997268 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:42.997500 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:42.997675 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:42.997999 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:42.998135 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:42.998313 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:42.998410 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:42.998619 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:42.998707 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:42.998954 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:42.999043 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:42.999292 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:42.999399 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:42.999611 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.000192 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.000432 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.000521 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.000743 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.000881 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.001050 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.001187 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.001355 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.001439 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.001672 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.001753 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851996-4-iscsi {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.002038 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.002147 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851996-4-iscsi {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.002345 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.002432 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.002651 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.002741 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.002985 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.003084 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.003379 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.003464 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.003688 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.003817 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.004014 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.004122 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.004319 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.004459 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.004621 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.004754 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.004946 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.005098 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.005260 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.005394 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.005576 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.005709 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.005891 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.006023 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.006190 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.006328 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.006497 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.006655 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.006802 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.006995 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.007137 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.007320 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.007435 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.007529 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.007735 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.007821 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.007983 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.008082 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.008279 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.008364 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.008588 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.008674 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.008902 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.009000 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.009219 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.009304 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.009466 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.009558 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.009714 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.009802 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.010017 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.010108 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.010332 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.010436 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.010638 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.010739 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.010971 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.011059 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.011278 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.011385 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.011581 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.011674 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.011883 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.011975 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.012186 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.012280 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.012487 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.012573 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.012791 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.012875 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.013095 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.013191 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.013401 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.013492 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.013713 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.013798 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.014012 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.014097 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.014332 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.014425 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.014648 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.014746 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.014984 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.015119 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.015312 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.016006 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.016162 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.016260 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.016500 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.016600 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.016820 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.016967 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.017141 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.017229 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.017461 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.017547 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.017763 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.017860 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.018066 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.018162 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.018370 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.018463 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.018675 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.018769 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.019023 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.019131 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.019325 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.019417 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.019575 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.019667 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.019872 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.019967 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.020175 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.020259 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.020480 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.020564 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.020782 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.020876 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.021086 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.021172 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.021389 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.021475 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.021682 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.021767 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.021984 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.022083 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.022285 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.022371 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.022588 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.022680 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.022903 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.023002 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.023210 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.023297 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.023510 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.023644 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.023813 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.023907 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.024109 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.024200 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.024411 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.024497 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.024716 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.024801 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.025028 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.025111 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.025330 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.025420 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.025631 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.025716 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.025932 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.026026 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.026232 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.026327 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.026535 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.026627 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.026833 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.026969 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.027156 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.027244 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.027466 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.027562 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.027764 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.027849 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.028064 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.028151 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.028367 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.028453 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.028667 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.028751 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.028969 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.029056 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.029271 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.029363 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.029567 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.029664 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.029869 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.029955 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.030175 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.030268 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.030474 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.030568 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.030773 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.030860 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.031122 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.031207 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.031421 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.031515 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.031720 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.031806 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.032019 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.032103 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.032312 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.032406 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.032609 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.032694 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.032902 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.032986 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.033196 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.033282 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.033514 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.033643 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.033814 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.033900 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.034120 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.034220 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.034424 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.034508 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.034728 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.034814 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.035073 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:21:43.035163 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.035399 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.035483 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.035728 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.035819 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.036035 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.036121 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.036362 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.036456 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.036687 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.036781 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.036999 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.037092 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.037307 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.037392 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.037613 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.037706 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.037928 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.038021 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.038230 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.038324 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.038535 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.038633 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.038840 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.038991 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.039173 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.039269 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.039486 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.039571 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.039798 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.039892 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.040106 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.040190 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.040416 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.040615 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.040731 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.040817 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.041038 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.041124 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.041345 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.041431 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.041663 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.041758 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.041973 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.042058 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.042278 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.042373 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.042591 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.042675 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.042956 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.043057 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.043265 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.043351 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.043588 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.043712 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.043904 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.043998 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.044215 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.044310 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.044520 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.044652 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.044828 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.044921 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.045139 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.045232 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.045459 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.045544 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.045768 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.045867 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.046082 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.046168 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.046390 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.046475 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.046725 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.046818 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.047062 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.047159 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.047374 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.047465 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.047678 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.047776 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.047987 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.048081 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.048306 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.048391 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.048617 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.048716 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.048927 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.049013 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.049236 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.049319 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.049540 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.049633 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.049847 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.049933 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.050154 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.050239 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.050730 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.050819 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.051055 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.051144 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.051358 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.051445 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.051661 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.051746 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.051958 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.052042 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.052261 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.052344 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.052579 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.052674 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.052878 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.052964 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.053198 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.053291 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.053497 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.053582 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.053805 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.053892 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.054112 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.054207 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.054419 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.054504 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.054717 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.054803 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.055046 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.055145 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.055350 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.055435 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.055653 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.055741 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.055952 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.056089 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.056266 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.056352 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.056566 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.056652 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.056867 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.056955 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.057171 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.057256 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.057471 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.057557 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.057773 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.057860 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.058076 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.058168 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.058381 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.058473 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.058685 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.058771 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.059019 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.059125 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.059330 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.059416 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.059635 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.059720 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.059945 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.060040 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.060262 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.060414 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.060589 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.060674 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.060892 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.060978 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.061206 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.061304 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.061523 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.061608 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.061832 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.061918 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.062134 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.062720 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.062969 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.063057 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.063272 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.063363 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.063573 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.063667 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.063869 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.063953 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.064170 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.064256 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.064469 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.064555 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.064773 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.064858 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.065070 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.065154 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.065371 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.065464 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.065671 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.065755 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.065976 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.066069 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.066279 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.066365 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.066580 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.066666 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.066895 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.066984 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.067201 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.067287 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.067506 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.067638 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.067823 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.067917 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.068142 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.068227 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.068477 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.068562 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.068795 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.068894 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.069113 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.069199 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.069420 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.069505 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.069733 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.069832 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.070041 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.070127 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.070348 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.070433 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.070652 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.070746 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.070986 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.071086 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.071302 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.071388 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.071607 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.071693 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.071922 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.072006 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.072227 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.072311 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.072539 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.072625 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.072842 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.072926 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.073159 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.073243 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.073458 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.073544 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.073771 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.073855 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.074086 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.074184 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.074419 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.074505 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.074738 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.074825 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.075080 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.075165 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.075387 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.075474 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.075699 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.075798 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.076007 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.076103 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.076313 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.076398 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.076616 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.076701 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.076924 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.077018 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.077238 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.077324 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.077544 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.077628 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.078392 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.078613 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.078728 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.078806 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.079076 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.079183 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.079390 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.079485 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.079697 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.079782 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.079997 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.080089 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.080308 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.080394 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.080625 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.080711 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.080954 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.081039 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.081260 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.081354 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.081569 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.081656 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.081881 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.081966 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.082187 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.082273 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.082495 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.082589 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.082802 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.082943 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.083128 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.083215 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.083430 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.083517 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.083731 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.083825 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.084039 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.084170 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.084346 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.084432 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.084651 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.084749 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.084956 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.085040 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.085259 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.085343 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.085560 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.085654 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.085861 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.085947 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.086161 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.086246 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.086465 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.086628 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.086772 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.086856 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.087100 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.087185 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.087415 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.087513 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.087728 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.087814 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.088029 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.088115 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.088330 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.088419 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.088630 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.088714 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.088939 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.089023 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.089237 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.089324 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.089537 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.089628 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.089832 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.089924 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.090131 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.090216 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.090461 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.090546 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.090767 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.090896 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.091120 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.091232 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.091417 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.091514 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.091720 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.091815 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.092027 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.092114 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.092332 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.092417 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.092636 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.092732 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.092943 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.093028 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.093248 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.093332 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.093588 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.093682 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.093896 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.093982 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.094203 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.094296 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.094506 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.094601 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.094815 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.094949 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.095153 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.095250 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.095456 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.095550 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.095763 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.095857 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.096069 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.096156 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.096410 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.096503 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.096669 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.096754 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.096976 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.097060 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.097288 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.097538 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.097848 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.097934 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.098167 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.098251 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.098482 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.098568 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.098795 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.098900 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.099150 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.099254 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.099474 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.099560 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.099796 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.099881 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.100119 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.100216 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.100422 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.100516 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.100728 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.100825 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.101031 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.101118 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.101332 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.101418 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.101632 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.101718 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.101930 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.102015 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.102231 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.102324 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.102528 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.102613 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.102831 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.102979 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.103152 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.103249 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.103454 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.103538 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.103753 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.103846 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.104054 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.104149 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.104359 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.104446 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.104657 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.104749 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.104959 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.105054 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.105255 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.105347 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.105558 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.105642 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.105864 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.105951 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.106163 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.106253 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.106461 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.106546 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.106758 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.106844 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.107093 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.107195 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.107406 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.107499 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.107725 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.107814 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.108052 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.108149 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.108374 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.108459 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.108674 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.108760 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.108976 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.109062 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.109321 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.109416 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.109618 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.109703 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.109918 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.110002 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.110218 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.110423 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.110521 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.110601 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.110817 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.110931 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.111139 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.111248 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.111440 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.111532 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.111742 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.111827 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.112047 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.112140 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.112351 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.112444 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.112650 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.112736 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.112948 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.113034 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.113246 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.113338 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.113544 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.113637 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.113845 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.113939 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.114143 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.114236 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.114442 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.114526 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.114745 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.114832 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.115070 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.115175 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.115370 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.115455 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.115668 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.115762 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.115962 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.116048 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.116260 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.116353 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.116561 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.116647 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.116859 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.116945 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.117157 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.117256 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.117461 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.117545 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.117765 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.117850 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.118068 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.118189 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.118366 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.118463 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.118678 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.118772 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.119007 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.119116 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.119311 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.119403 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.119613 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.119697 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.119913 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.120008 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.120210 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.120304 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.120514 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.120599 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.120823 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.120918 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.121131 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.121216 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.121431 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.121517 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.121732 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.121818 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.122028 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.122168 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.122328 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.122422 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.122626 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.122712 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.122953 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.123040 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.123253 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.123354 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.123550 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.123635 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.123845 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.123937 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.124142 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.124234 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.124437 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.124560 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.125240 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.125335 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.125556 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.125654 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.125859 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.125952 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.126159 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.126244 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.126456 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.126555 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.126755 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.126840 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.127105 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.127203 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.127409 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.127495 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.127745 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.127879 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.128056 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.128156 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.128368 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.128466 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.128671 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.128758 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.128976 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.129074 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.129278 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.129364 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.129578 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.129665 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.129876 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.129968 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.130185 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.130279 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.130490 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.130574 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.130786 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.130899 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.131109 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.131196 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.131408 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.131492 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.131717 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.131814 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.132024 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.132110 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.132332 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.132417 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.132644 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.132738 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.132963 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.133048 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.133259 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.133344 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.133562 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.133657 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.133864 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.133949 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.134165 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.134250 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.134468 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.134567 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.134770 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.134855 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.135095 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.135180 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.135400 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.135488 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.135705 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.135797 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.136008 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.136092 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.136313 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.136400 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.136611 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.136697 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.136909 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.136994 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.137206 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.137292 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.137505 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.137591 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.137803 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.137935 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.138113 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.138198 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.138416 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.138524 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.138717 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.138907 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.139033 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.139127 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.139338 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.139431 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.139638 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.139734 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.139937 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.140054 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.140891 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.141028 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.141217 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.141317 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.141531 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.141627 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.141834 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.141919 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.142137 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.142223 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.142445 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.142530 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.142749 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.142834 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.143076 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.143165 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.143377 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.143487 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.143795 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.143893 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.144097 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.144189 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.144401 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.144491 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.144700 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.144792 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.144999 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.145093 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.145299 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.145394 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.145609 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.145702 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.145904 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.145990 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.146202 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.146288 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.146500 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.146598 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.146798 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.146901 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.147127 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.147210 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.147444 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.147546 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.147761 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.147852 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.148148 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.148232 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.148449 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.148610 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.148766 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.148851 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.149151 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.149237 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.149455 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.149549 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.149764 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.149855 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.150076 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.150169 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.150392 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.150477 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.150687 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.150772 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.151020 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.151126 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.151327 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.151415 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.151632 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.151718 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.151953 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.152038 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.152260 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.152393 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.152568 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.152661 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.152864 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.152957 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.153165 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.153250 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.153487 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.153593 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.153796 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.153891 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.154103 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.154206 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.154423 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.154516 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.154812 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.154930 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.155142 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.155257 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.155457 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.155545 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.155778 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.155873 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.156105 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.156200 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.156406 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.156494 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.156709 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.156795 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.157006 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.157101 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.157306 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.157393 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.157609 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.157694 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.157911 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.158005 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.158218 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.158305 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.158523 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.158610 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.158826 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.158967 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.159148 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.159235 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.159448 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.159534 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.159752 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.159846 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.160049 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.160134 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.160360 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.160445 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.160666 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.160762 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.160983 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.161077 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.161300 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.161394 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.161598 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.161687 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.161911 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.161996 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.162213 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.162306 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.162510 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.162597 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.162808 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.162912 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.163130 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.163234 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.163437 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.163530 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.163751 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.163837 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.164065 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.164160 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.164384 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.164472 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.164708 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.164800 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.165016 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.165113 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.165333 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.165419 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.165651 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.165736 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.165963 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.166050 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.166275 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.166368 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.166588 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.166673 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.166910 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.167012 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.167214 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.167309 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.167518 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.167604 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.167816 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.167902 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.168116 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.168242 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.168412 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.168512 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.168712 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.168797 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.169009 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.169095 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.169307 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.169403 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.169606 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.169691 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.169909 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.170002 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.170215 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.170314 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.170522 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.170608 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.170825 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.170963 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.171149 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.171285 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.171449 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.171538 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.171774 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.171871 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.172077 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.172163 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.172401 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.172483 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.172713 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.172798 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.173023 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.173110 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.173340 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.173424 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.173650 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.173734 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.173963 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.174050 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.174276 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.174361 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.174585 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.174677 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.174915 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.175007 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.175231 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.175592 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.175809 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.175906 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.176115 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.176203 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.176421 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.176514 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.176728 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.176822 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.177038 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.177125 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.177347 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.177553 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.177865 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.177964 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.178178 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.178263 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.178489 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.178575 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.178837 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.179029 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.179115 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.179195 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.179430 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.179517 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.179738 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.179827 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.180045 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.180131 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.180354 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.180446 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.180658 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.180741 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.180971 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.181064 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.181284 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.181426 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.181605 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.181694 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.181925 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.182010 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.182233 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.182330 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.182543 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.182629 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.182853 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.182968 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.183183 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.183286 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.183493 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.183590 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.183830 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.183916 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.184136 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.184224 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.184442 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.184527 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.184749 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.184835 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.185059 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.185184 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.185495 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.185605 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.185689 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.185841 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.185963 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.186052 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.186271 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.186355 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.186575 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.186669 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.186896 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.186987 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.187718 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.187811 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.188025 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.188128 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.188334 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.188472 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.188658 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.188752 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.188972 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.189070 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.189279 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.189366 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.189607 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.189710 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.189897 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.189985 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.190211 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.190404 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.190718 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.190804 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.191058 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.191149 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.191377 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.191501 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.191695 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.191795 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.192006 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.192103 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.192315 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.192402 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.192628 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.192726 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.192927 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.193013 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.193228 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.193314 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.193533 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.193698 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.193837 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.193924 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.194137 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.194224 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.194438 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.194535 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.194744 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.194831 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.195068 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.195167 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.195369 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.195465 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.195672 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.195757 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.195981 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.196197 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.196509 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.196596 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.196839 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.196937 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.197158 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.197243 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.197475 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.197561 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.197787 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.197874 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.198090 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.198186 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.198394 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.198487 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.198697 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.198783 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.199024 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.199136 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.199333 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.199433 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.199634 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.199728 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.199936 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.200032 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.200237 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.200322 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.200540 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.200627 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.200847 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.200946 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.201142 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.201235 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.201445 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.201533 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.201744 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.201840 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.202042 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.202127 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.202352 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.202438 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.202652 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.202797 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.203520 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.203609 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.203828 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.203913 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.204130 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.204226 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.204430 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.204518 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.204730 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.204815 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.205025 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.205112 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.205325 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.205418 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.205621 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.205706 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.205922 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.206010 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.206218 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.206304 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.206520 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.206612 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.206816 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.206921 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.207119 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.207204 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.207429 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.207527 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.207747 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.207834 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.208048 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.208142 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.208354 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.208452 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.208694 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.208778 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.209000 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.209102 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.209307 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.209417 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.209611 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.209705 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.209920 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.210008 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.210226 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.210322 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.210555 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.210641 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.210923 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.211109 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.211424 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.211512 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.211743 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.211830 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.212068 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.212155 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.212391 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.212477 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.212696 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.212783 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.213000 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.213087 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.213301 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.213389 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.213605 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.213692 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.213911 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.213998 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.214216 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.214312 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.214520 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.214605 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.214823 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.214940 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.215153 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.215240 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.215458 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.215545 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.215763 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.215857 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.216064 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.216150 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.216369 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.216455 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.216669 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.216763 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.216971 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.217057 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.217273 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.217366 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.217576 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.217662 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.217875 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.217961 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.218179 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.218264 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.218515 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.218609 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.218833 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.218937 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.219175 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.219263 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.219488 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.219580 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.219798 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.219884 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.220101 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.220196 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.220408 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.220496 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.220713 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.220797 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.221013 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.221111 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.221316 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.221401 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.221637 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.221723 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.221944 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.222038 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.222248 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.222336 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.222558 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.222643 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.222976 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.223069 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.223291 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.223391 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.223607 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.223693 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.223911 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.223997 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.224226 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.224311 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.224542 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.224628 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.224852 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.224949 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.225160 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.225246 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.225463 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.225557 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.225772 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.225908 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.226101 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.226188 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.226421 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.226515 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.226743 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.226830 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.227069 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.227156 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.227370 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.227469 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.227671 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.227756 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.227975 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.228060 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.228279 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.228365 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.228580 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.228665 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.228881 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.228980 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.229178 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.229267 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.229477 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.229570 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.229771 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.229857 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.230071 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.230159 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.230369 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.230456 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.230668 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.230761 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.230995 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.231086 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.231292 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.231377 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.231590 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.231689 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.231887 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.231973 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.232182 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.232268 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.232480 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.232574 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.232774 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.232860 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.233070 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.233155 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.233366 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.233460 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.233663 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.233751 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.233959 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.234079 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.234284 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.234383 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.234580 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.234666 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.234888 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.234976 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.235236 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.235324 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.235542 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.235637 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.235859 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.235987 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.236166 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.236255 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.236473 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.236567 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.236775 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.236867 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.237089 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.237177 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.237402 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.237494 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.237710 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.237797 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.238014 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.238101 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.238317 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.238402 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.238630 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.238728 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.238966 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.239066 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.239272 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.239358 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.239574 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.239678 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.239879 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.239966 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.240183 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.240276 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.240489 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.240585 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.240814 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.240901 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.241112 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.241197 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.241432 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.241528 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.241746 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.241832 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.242057 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.242151 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.242362 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.242508 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.242669 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.242757 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.242999 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.243088 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.243318 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.243406 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.243625 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.243720 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.243928 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.244014 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.244231 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.244317 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.244533 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.244626 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.244838 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.244932 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.245140 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.245226 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.245446 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.245533 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.245754 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.245849 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.246066 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.246150 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.246378 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.246464 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.246696 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.246790 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.247021 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.247110 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.247339 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.247423 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.247663 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.247751 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.247986 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.248078 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.248300 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.248386 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.248629 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.248717 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.248948 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.249047 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.249259 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.249358 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.249566 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.250159 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.250381 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.250479 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.250623 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 06 14:21:43.250719 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:21:43.250932 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 06 14:21:43.404224 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: INFO dbcounter [None req-8a2e7ba8-9254-499a-90ee-5b7cf6d049ee None None] Registered counter for database nova_api Aug 06 14:21:43.412554 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: INFO dbcounter [None req-4b36d918-c861-4c61-a4ef-66b183046615 None None] Registered counter for database nova_api Aug 06 14:21:43.424295 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG oslo_db.sqlalchemy.engines [None req-8a2e7ba8-9254-499a-90ee-5b7cf6d049ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103174) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 14:21:43.431089 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG dbcounter [-] [103174] Writer thread running {{(pid=103174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 14:21:43.432173 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG oslo_db.sqlalchemy.engines [None req-4b36d918-c861-4c61-a4ef-66b183046615 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 14:21:43.439108 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG dbcounter [-] [103173] Writer thread running {{(pid=103173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 14:21:43.486419 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.context [None req-8a2e7ba8-9254-499a-90ee-5b7cf6d049ee None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fd953adc-bbd7-49ea-a6a5-a2e44aba103c(cell1) {{(pid=103174) load_cells /opt/stack/nova/nova/context.py:464}} Aug 06 14:21:43.490274 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG oslo_concurrency.lockutils [None req-8a2e7ba8-9254-499a-90ee-5b7cf6d049ee None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:21:43.490742 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG oslo_concurrency.lockutils [None req-8a2e7ba8-9254-499a-90ee-5b7cf6d049ee None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:21:43.492312 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG oslo_concurrency.lockutils [None req-8a2e7ba8-9254-499a-90ee-5b7cf6d049ee None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:21:43.493029 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG oslo_concurrency.lockutils [None req-8a2e7ba8-9254-499a-90ee-5b7cf6d049ee None None] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:21:43.493468 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG oslo_concurrency.lockutils [None req-8a2e7ba8-9254-499a-90ee-5b7cf6d049ee None None] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:21:43.493737 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.context [None req-4b36d918-c861-4c61-a4ef-66b183046615 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fd953adc-bbd7-49ea-a6a5-a2e44aba103c(cell1) {{(pid=103173) load_cells /opt/stack/nova/nova/context.py:464}} Aug 06 14:21:43.495453 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG oslo_concurrency.lockutils [None req-8a2e7ba8-9254-499a-90ee-5b7cf6d049ee None None] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:21:43.497431 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: INFO dbcounter [None req-8a2e7ba8-9254-499a-90ee-5b7cf6d049ee None None] Registered counter for database nova_cell0 Aug 06 14:21:43.497592 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG oslo_concurrency.lockutils [None req-4b36d918-c861-4c61-a4ef-66b183046615 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:21:43.498072 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG oslo_concurrency.lockutils [None req-4b36d918-c861-4c61-a4ef-66b183046615 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:21:43.499684 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG oslo_concurrency.lockutils [None req-4b36d918-c861-4c61-a4ef-66b183046615 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:21:43.500942 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG oslo_concurrency.lockutils [None req-4b36d918-c861-4c61-a4ef-66b183046615 None None] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:21:43.501387 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG oslo_concurrency.lockutils [None req-4b36d918-c861-4c61-a4ef-66b183046615 None None] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:21:43.503338 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: INFO dbcounter [None req-8a2e7ba8-9254-499a-90ee-5b7cf6d049ee None None] Registered counter for database nova_cell1 Aug 06 14:21:43.503443 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG oslo_concurrency.lockutils [None req-4b36d918-c861-4c61-a4ef-66b183046615 None None] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:21:43.505427 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: INFO dbcounter [None req-4b36d918-c861-4c61-a4ef-66b183046615 None None] Registered counter for database nova_cell0 Aug 06 14:21:43.510857 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: INFO dbcounter [None req-4b36d918-c861-4c61-a4ef-66b183046615 None None] Registered counter for database nova_cell1 Aug 06 14:21:43.511123 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG oslo_db.sqlalchemy.engines [None req-8a2e7ba8-9254-499a-90ee-5b7cf6d049ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103174) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 14:21:43.513301 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG oslo_db.sqlalchemy.engines [None req-8a2e7ba8-9254-499a-90ee-5b7cf6d049ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103174) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 14:21:43.517953 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG oslo_db.sqlalchemy.engines [None req-4b36d918-c861-4c61-a4ef-66b183046615 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 14:21:43.518335 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG dbcounter [-] [103174] Writer thread running {{(pid=103174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 14:21:43.520986 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG dbcounter [-] [103174] Writer thread running {{(pid=103174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 14:21:43.522447 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG dbcounter [-] [103173] Writer thread running {{(pid=103173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 14:21:43.523118 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG oslo_db.sqlalchemy.engines [None req-4b36d918-c861-4c61-a4ef-66b183046615 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 14:21:43.662899 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG dbcounter [-] [103173] Writer thread running {{(pid=103173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 14:21:43.663081 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: INFO dbcounter [None req-8a2e7ba8-9254-499a-90ee-5b7cf6d049ee None None] Registered counter for database nova_cell0 Aug 06 14:21:43.671347 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: INFO dbcounter [None req-4b36d918-c861-4c61-a4ef-66b183046615 None None] Registered counter for database nova_cell0 Aug 06 14:21:43.672485 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG oslo_db.sqlalchemy.engines [None req-8a2e7ba8-9254-499a-90ee-5b7cf6d049ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103174) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 14:21:43.676972 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG dbcounter [-] [103174] Writer thread running {{(pid=103174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 14:21:43.681179 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG oslo_db.sqlalchemy.engines [None req-4b36d918-c861-4c61-a4ef-66b183046615 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 14:21:43.685477 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG dbcounter [-] [103173] Writer thread running {{(pid=103173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 14:21:44.007341 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: WARNING keystonemiddleware.auth_token [None req-8a2e7ba8-9254-499a-90ee-5b7cf6d049ee None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 06 14:21:44.010487 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: WARNING keystonemiddleware.auth_token [None req-4b36d918-c861-4c61-a4ef-66b183046615 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 06 14:21:44.014446 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: WARNING keystonemiddleware.auth_token [None req-8a2e7ba8-9254-499a-90ee-5b7cf6d049ee None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 06 14:21:44.018149 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: WARNING keystonemiddleware.auth_token [None req-4b36d918-c861-4c61-a4ef-66b183046615 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 06 14:21:44.358607 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: WARNING keystonemiddleware.auth_token [None req-8a2e7ba8-9254-499a-90ee-5b7cf6d049ee None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 06 14:21:44.360595 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: WARNING keystonemiddleware.auth_token [None req-4b36d918-c861-4c61-a4ef-66b183046615 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 06 14:21:44.364981 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: WARNING keystonemiddleware.auth_token [None req-8a2e7ba8-9254-499a-90ee-5b7cf6d049ee None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 06 14:21:44.366505 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: WARNING keystonemiddleware.auth_token [None req-4b36d918-c861-4c61-a4ef-66b183046615 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 06 14:21:44.370163 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c9c9e709c0 pid: 103174 (default app) Aug 06 14:21:44.371734 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c9c9e709c0 pid: 103173 (default app) Aug 06 14:21:44.372259 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-8a2e7ba8-9254-499a-90ee-5b7cf6d049ee None None] Calling method '>' {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:21:44.373418 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.requestlog [None req-8a2e7ba8-9254-499a-90ee-5b7cf6d049ee None None] 10.222.0.17 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001709 Aug 06 14:21:44.373834 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: [pid: 103174|app: 0|req: 1/1] 10.222.0.17 () {50 vars in 788 bytes} [Sat Aug 6 14:21:44 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:22:59.783479 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-4b36d918-c861-4c61-a4ef-66b183046615 None None] Calling method '>' {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:22:59.784680 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-4b36d918-c861-4c61-a4ef-66b183046615 None None] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001958 Aug 06 14:22:59.785075 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 1/2] 10.222.0.17 () {54 vars in 931 bytes} [Sat Aug 6 14:22:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:22:59.801597 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG dbcounter [-] [103174] Writing DB stats nova_api:SELECT=3 {{(pid=103174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:22:59.802450 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG dbcounter [-] [103174] Writing DB stats nova_cell0:SELECT=3 {{(pid=103174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:22:59.803322 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG dbcounter [-] [103174] Writing DB stats nova_cell1:SELECT=3 {{(pid=103174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:22:59.804249 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG dbcounter [-] [103174] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:23:00.644043 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-2b233ddd-7bbc-4fba-b668-c63631726f75 admin admin] Calling method '>' {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:23:00.677546 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.requestlog [None req-2b233ddd-7bbc-4fba-b668-c63631726f75 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.886309 Aug 06 14:23:00.678968 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: [pid: 103174|app: 0|req: 2/3] 10.222.0.17 () {60 vars in 1292 bytes} [Sat Aug 6 14:22:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:23:02.919905 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-4b36d918-c861-4c61-a4ef-66b183046615 None None] Calling method '>' {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:23:02.921027 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-4b36d918-c861-4c61-a4ef-66b183046615 None None] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002032 Aug 06 14:23:02.921411 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 2/4] 10.222.0.17 () {54 vars in 931 bytes} [Sat Aug 6 14:23:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:23:03.391450 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-66940c45-5ab9-4705-bcce-4b2063ac7e7b admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "rxtx_factor": 1.0, "ram": 256, "disk": 1, "vcpus": 1, "name": "cirros256", "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:23:03.413840 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 14:23:03.413840 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: warnings.warn(msg) Aug 06 14:23:03.447149 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.requestlog [None req-66940c45-5ab9-4705-bcce-4b2063ac7e7b admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.518459 Aug 06 14:23:03.447726 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: [pid: 103174|app: 0|req: 3/5] 10.222.0.17 () {64 vars in 1283 bytes} [Sat Aug 6 14:23:02 2022] POST /compute/v2.1/flavors => generated 407 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 06 14:23:03.461617 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG dbcounter [-] [103173] Writing DB stats nova_api:SELECT=3 {{(pid=103173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:23:03.462560 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG dbcounter [-] [103173] Writing DB stats nova_cell0:SELECT=3 {{(pid=103173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:23:03.463926 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG dbcounter [-] [103173] Writing DB stats nova_cell1:SELECT=3 {{(pid=103173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:23:03.464797 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG dbcounter [-] [103173] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:23:03.672933 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-e1c71aff-2935-4152-a347-76572ba91754 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:23:03.677494 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 14:23:03.677494 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: warnings.warn(msg) Aug 06 14:23:03.748225 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-e1c71aff-2935-4152-a347-76572ba91754 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.292045 Aug 06 14:23:03.749003 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 3/6] 10.222.0.17 () {64 vars in 1336 bytes} [Sat Aug 6 14:23:03 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:23:05.998125 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-66940c45-5ab9-4705-bcce-4b2063ac7e7b admin admin] Calling method '>' {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:23:05.999163 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.requestlog [None req-66940c45-5ab9-4705-bcce-4b2063ac7e7b admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001982 Aug 06 14:23:05.999741 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: [pid: 103174|app: 0|req: 4/7] 10.222.0.17 () {54 vars in 931 bytes} [Sat Aug 6 14:23:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:23:06.657010 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-6ecf5628-443f-48bd-8ddb-c7fb086eb1c3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 512, "id": "d1", "name": "ds512M", "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:23:06.676815 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 14:23:06.676815 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: warnings.warn(msg) Aug 06 14:23:06.697653 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-6ecf5628-443f-48bd-8ddb-c7fb086eb1c3 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.691696 Aug 06 14:23:06.705423 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 4/8] 10.222.0.17 () {64 vars in 1283 bytes} [Sat Aug 6 14:23:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 14:23:06.711690 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-3d2fb3e0-d6b0-4553-826f-8412692f2547 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:23:06.715968 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 14:23:06.715968 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: warnings.warn(msg) Aug 06 14:23:06.758363 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.requestlog [None req-3d2fb3e0-d6b0-4553-826f-8412692f2547 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.051064 Aug 06 14:23:06.759572 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: [pid: 103174|app: 0|req: 5/9] 10.222.0.17 () {64 vars in 1336 bytes} [Sat Aug 6 14:23:06 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:23:09.031444 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-6ecf5628-443f-48bd-8ddb-c7fb086eb1c3 admin admin] Calling method '>' {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:23:09.032659 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-6ecf5628-443f-48bd-8ddb-c7fb086eb1c3 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Aug 06 14:23:09.033064 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 5/10] 10.222.0.17 () {54 vars in 931 bytes} [Sat Aug 6 14:23:09 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:23:09.434273 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-20e593e9-6cf2-4cc7-8f65-4b5d167f8959 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "id": "d2", "os-flavor-access:is_public": true, "vcpus": 1, "disk": 10, "swap": 0, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:23:09.455699 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.requestlog [None req-20e593e9-6cf2-4cc7-8f65-4b5d167f8959 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.415833 Aug 06 14:23:09.463601 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: [pid: 103174|app: 0|req: 6/11] 10.222.0.17 () {64 vars in 1283 bytes} [Sat Aug 6 14:23:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 14:23:09.469840 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-981b0ffa-0d9e-45f2-b6b1-4b6aaf741e3d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:23:09.493742 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-981b0ffa-0d9e-45f2-b6b1-4b6aaf741e3d admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028746 Aug 06 14:23:09.494397 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 6/12] 10.222.0.17 () {64 vars in 1336 bytes} [Sat Aug 6 14:23:09 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:23:11.677534 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-20e593e9-6cf2-4cc7-8f65-4b5d167f8959 admin admin] Calling method '>' {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:23:11.677534 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.requestlog [None req-20e593e9-6cf2-4cc7-8f65-4b5d167f8959 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001752 Aug 06 14:23:11.677534 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: [pid: 103174|app: 0|req: 7/13] 10.222.0.17 () {54 vars in 931 bytes} [Sat Aug 6 14:23:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:23:12.109439 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-41e85a09-0075-4fd4-a177-07a12375356f admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "d3", "swap": 0, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "disk": 10, "ram": 2048}} {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:23:12.137081 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-41e85a09-0075-4fd4-a177-07a12375356f admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.453250 Aug 06 14:23:12.137935 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 7/14] 10.222.0.17 () {64 vars in 1283 bytes} [Sat Aug 6 14:23:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 06 14:23:12.151404 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-d3f21cb6-0a93-4709-9bf4-2251f93c79db admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:23:12.181142 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.requestlog [None req-d3f21cb6-0a93-4709-9bf4-2251f93c79db admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033244 Aug 06 14:23:12.183167 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: [pid: 103174|app: 0|req: 8/15] 10.222.0.17 () {64 vars in 1336 bytes} [Sat Aug 6 14:23:12 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:23:14.385241 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-41e85a09-0075-4fd4-a177-07a12375356f admin admin] Calling method '>' {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:23:14.386236 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-41e85a09-0075-4fd4-a177-07a12375356f admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Aug 06 14:23:14.386624 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 8/16] 10.222.0.17 () {54 vars in 931 bytes} [Sat Aug 6 14:23:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:23:14.826926 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-92823ac6-0b3a-4b1b-947b-6fae4178c138 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "disk": 20, "os-flavor-access:is_public": true, "vcpus": 4, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "id": "d4", "rxtx_factor": 1.0}} {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:23:14.848049 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.requestlog [None req-92823ac6-0b3a-4b1b-947b-6fae4178c138 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.455581 Aug 06 14:23:14.849459 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: [pid: 103174|app: 0|req: 9/17] 10.222.0.17 () {64 vars in 1283 bytes} [Sat Aug 6 14:23:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 06 14:23:14.862417 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-19b97218-34fe-483f-8b2c-4a3d23784ddc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:23:14.889794 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-19b97218-34fe-483f-8b2c-4a3d23784ddc admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030968 Aug 06 14:23:14.890528 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 9/18] 10.222.0.17 () {64 vars in 1336 bytes} [Sat Aug 6 14:23:14 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:23:17.070450 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-92823ac6-0b3a-4b1b-947b-6fae4178c138 admin admin] Calling method '>' {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:23:17.071537 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.requestlog [None req-92823ac6-0b3a-4b1b-947b-6fae4178c138 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Aug 06 14:23:17.071893 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: [pid: 103174|app: 0|req: 10/19] 10.222.0.17 () {54 vars in 931 bytes} [Sat Aug 6 14:23:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:23:17.485265 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-71939b78-fe29-4425-9967-1cec7e73cae1 admin admin] Calling method '>' {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:23:17.517133 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-71939b78-fe29-4425-9967-1cec7e73cae1 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.438181 Aug 06 14:23:17.517855 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 10/20] 10.222.0.17 () {60 vars in 1292 bytes} [Sat Aug 6 14:23:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:23:19.762433 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-92823ac6-0b3a-4b1b-947b-6fae4178c138 admin admin] Calling method '>' {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:23:19.763526 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.requestlog [None req-92823ac6-0b3a-4b1b-947b-6fae4178c138 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001687 Aug 06 14:23:19.763935 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: [pid: 103174|app: 0|req: 11/21] 10.222.0.17 () {54 vars in 931 bytes} [Sat Aug 6 14:23:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:23:20.218071 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-8792665d-b8fc-40a1-9e46-9b17a0179752 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "swap": 0, "vcpus": 1, "name": "m1.tiny", "os-flavor-access:is_public": true, "ram": 512, "rxtx_factor": 1.0, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:23:20.238038 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-8792665d-b8fc-40a1-9e46-9b17a0179752 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.468166 Aug 06 14:23:20.238601 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 11/22] 10.222.0.17 () {64 vars in 1283 bytes} [Sat Aug 6 14:23:19 2022] POST /compute/v2.1/flavors => generated 402 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 14:23:20.252225 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-bc6f0e08-cc48-488e-ba11-65cd970510ac admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:23:20.276130 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.requestlog [None req-bc6f0e08-cc48-488e-ba11-65cd970510ac admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027522 Aug 06 14:23:20.276698 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: [pid: 103174|app: 0|req: 12/23] 10.222.0.17 () {64 vars in 1333 bytes} [Sat Aug 6 14:23:20 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:23:22.479243 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-8792665d-b8fc-40a1-9e46-9b17a0179752 admin admin] Calling method '>' {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:23:22.480253 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-8792665d-b8fc-40a1-9e46-9b17a0179752 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001546 Aug 06 14:23:22.481362 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 12/24] 10.222.0.17 () {54 vars in 931 bytes} [Sat Aug 6 14:23:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:23:22.883321 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-4505bc2b-a2b2-4386-96f1-3bcce3875310 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "2", "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "os-flavor-access:is_public": true, "name": "m1.small", "ram": 2048}} {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:23:22.901959 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.requestlog [None req-4505bc2b-a2b2-4386-96f1-3bcce3875310 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.414974 Aug 06 14:23:22.903152 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: [pid: 103174|app: 0|req: 13/25] 10.222.0.17 () {64 vars in 1283 bytes} [Sat Aug 6 14:23:22 2022] POST /compute/v2.1/flavors => generated 405 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 14:23:22.914959 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-29f6c3b9-364e-4f0b-aedc-0b3d78588dc4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:23:22.939481 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-29f6c3b9-364e-4f0b-aedc-0b3d78588dc4 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028158 Aug 06 14:23:22.940136 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 13/26] 10.222.0.17 () {64 vars in 1333 bytes} [Sat Aug 6 14:23:22 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:23:25.154070 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-4505bc2b-a2b2-4386-96f1-3bcce3875310 admin admin] Calling method '>' {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:23:25.155644 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.requestlog [None req-4505bc2b-a2b2-4386-96f1-3bcce3875310 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.005259 Aug 06 14:23:25.156050 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: [pid: 103174|app: 0|req: 14/27] 10.222.0.17 () {54 vars in 931 bytes} [Sat Aug 6 14:23:25 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:23:25.577005 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-467cb4ad-0b14-406b-8da5-fe585f958240 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "disk": 40, "ram": 4096, "name": "m1.medium"}} {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:23:25.598186 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-467cb4ad-0b14-406b-8da5-fe585f958240 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.436181 Aug 06 14:23:25.598827 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 14/28] 10.222.0.17 () {64 vars in 1283 bytes} [Sat Aug 6 14:23:25 2022] POST /compute/v2.1/flavors => generated 406 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 06 14:23:25.610883 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-a8e7fa9d-01a4-4864-8f92-70738ed558ff admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:23:25.634531 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.requestlog [None req-a8e7fa9d-01a4-4864-8f92-70738ed558ff admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027375 Aug 06 14:23:25.635130 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: [pid: 103174|app: 0|req: 15/29] 10.222.0.17 () {64 vars in 1333 bytes} [Sat Aug 6 14:23:25 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:23:27.890159 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-467cb4ad-0b14-406b-8da5-fe585f958240 admin admin] Calling method '>' {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:23:27.891936 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-467cb4ad-0b14-406b-8da5-fe585f958240 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002199 Aug 06 14:23:27.892406 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 15/30] 10.222.0.17 () {54 vars in 931 bytes} [Sat Aug 6 14:23:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:23:28.350095 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-73b91cb8-7fea-49fa-a41d-f443f0059a54 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "ram": 8192, "disk": 80, "rxtx_factor": 1.0, "id": "4", "os-flavor-access:is_public": true, "swap": 0, "name": "m1.large"}} {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:23:28.370062 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.requestlog [None req-73b91cb8-7fea-49fa-a41d-f443f0059a54 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.471711 Aug 06 14:23:28.370709 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: [pid: 103174|app: 0|req: 16/31] 10.222.0.17 () {64 vars in 1283 bytes} [Sat Aug 6 14:23:27 2022] POST /compute/v2.1/flavors => generated 405 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 14:23:28.382585 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-ecae881d-acb7-4df0-986b-be407048dfce admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:23:28.408478 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-ecae881d-acb7-4df0-986b-be407048dfce admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029449 Aug 06 14:23:28.409054 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 16/32] 10.222.0.17 () {64 vars in 1333 bytes} [Sat Aug 6 14:23:28 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:23:30.634587 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-73b91cb8-7fea-49fa-a41d-f443f0059a54 admin admin] Calling method '>' {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:23:30.635664 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.requestlog [None req-73b91cb8-7fea-49fa-a41d-f443f0059a54 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 Aug 06 14:23:30.636213 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: [pid: 103174|app: 0|req: 17/33] 10.222.0.17 () {54 vars in 931 bytes} [Sat Aug 6 14:23:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:23:31.081163 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-02f8868a-1986-4d89-a289-596eca981299 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 8, "id": "5", "ram": 16384, "disk": 160}} {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:23:31.102493 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-02f8868a-1986-4d89-a289-596eca981299 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.460112 Aug 06 14:23:31.110902 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 17/34] 10.222.0.17 () {64 vars in 1283 bytes} [Sat Aug 6 14:23:30 2022] POST /compute/v2.1/flavors => generated 408 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 14:23:31.115647 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-fc11d1d2-27b0-4ce7-a28e-5d08263ed9a9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:23:31.120378 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG dbcounter [-] [103174] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:23:31.142543 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.requestlog [None req-fc11d1d2-27b0-4ce7-a28e-5d08263ed9a9 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030451 Aug 06 14:23:31.143479 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: [pid: 103174|app: 0|req: 18/35] 10.222.0.17 () {64 vars in 1333 bytes} [Sat Aug 6 14:23:31 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:23:51.541454 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-02f8868a-1986-4d89-a289-596eca981299 admin admin] Calling method '>' {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:23:51.543006 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-02f8868a-1986-4d89-a289-596eca981299 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Aug 06 14:23:51.543409 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 18/36] 10.222.0.17 () {54 vars in 931 bytes} [Sat Aug 6 14:23:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:23:51.925536 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-f8968daf-cd8b-422a-99b7-0ed58c7c3cea admin admin] Calling method '>' {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:23:51.943589 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.requestlog [None req-f8968daf-cd8b-422a-99b7-0ed58c7c3cea admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.394108 Aug 06 14:23:51.944117 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: [pid: 103174|app: 0|req: 19/37] 10.222.0.17 () {60 vars in 1292 bytes} [Sat Aug 6 14:23:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:23:52.995130 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-02f8868a-1986-4d89-a289-596eca981299 admin admin] Calling method '>' {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:23:52.996624 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-02f8868a-1986-4d89-a289-596eca981299 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001939 Aug 06 14:23:52.997026 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 19/38] 10.222.0.17 () {56 vars in 1074 bytes} [Sat Aug 6 14:23:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:23:53.517629 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-c961c669-3649-43d5-8e59-7207e078157d admin admin] Calling method '>' {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:23:53.523196 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.wsgi [None req-c961c669-3649-43d5-8e59-7207e078157d admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 06 14:23:53.526413 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-c961c669-3649-43d5-8e59-7207e078157d admin admin] Request method failure captured: Aug 06 14:23:53.526413 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 06 14:23:53.526413 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: Accept: application/json Aug 06 14:23:53.526413 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: Accept-Encoding: gzip, deflate Aug 06 14:23:53.526413 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: Connection: keep-alive Aug 06 14:23:53.526413 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: Content-Length: 0 Aug 06 14:23:53.526413 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: Host: 10.222.0.17 Aug 06 14:23:53.526413 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: Openstack-Api-Version: compute 2.90 Aug 06 14:23:53.526413 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: Openstack-System-Scope: None Aug 06 14:23:53.526413 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: User-Agent: python-novaclient Aug 06 14:23:53.526413 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: X-Auth-Token: gAAAAABi7nl4q1hGGi4mQiXmGag0JjMh1Zh6gIDCy__6wJNkJjekU06hjASTOKEdIjdySXTTMDh13WUX7TU81c_myhouSKrbP8NNTkzoF8SVTDn7_MWfGgnp1rBsfm6N-uc8tS7EuGZSuGAXKa61bsZA1ofIE4RxyWRTKyvHLbBska5jRAJwKxo Aug 06 14:23:53.526413 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: X-Domain-Id: None Aug 06 14:23:53.526413 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: X-Domain-Name: None Aug 06 14:23:53.526413 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: X-Identity-Status: Confirmed Aug 06 14:23:53.526413 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: X-Is-Admin-Project: True Aug 06 14:23:53.526413 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: X-Openstack-Nova-Api-Version: 2.90 Aug 06 14:23:53.526413 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: X-Project-Domain-Id: default Aug 06 14:23:53.526413 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: X-Project-Domain-Name: Default Aug 06 14:23:53.526413 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: X-Project-Id: 3509ae96075e47edbbf7f243bb4b1186 Aug 06 14:23:53.526413 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: X-Project-Name: admin Aug 06 14:23:53.526413 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: X-Role: member,admin,reader Aug 06 14:23:53.526413 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: X-Roles: member,admin,reader Aug 06 14:23:53.528366 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3509ae96075e47edbbf7f243bb4b1186"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3509ae96075e47edbbf7f243bb4b1186"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3509ae96075e47edbbf7f243bb4b1186", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3509ae96075e47edbbf7f243bb4b1186"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 06 14:23:53.528366 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: X-Tenant: admin Aug 06 14:23:53.528366 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: X-Tenant-Id: 3509ae96075e47edbbf7f243bb4b1186 Aug 06 14:23:53.528366 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: X-Tenant-Name: admin Aug 06 14:23:53.528366 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: X-User: admin Aug 06 14:23:53.528366 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: X-User-Domain-Id: default Aug 06 14:23:53.528366 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: X-User-Domain-Name: Default Aug 06 14:23:53.528366 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: X-User-Id: b7c86189492e4a4d8e62d6e2879b6ae2 Aug 06 14:23:53.528366 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: X-User-Name: admin Aug 06 14:23:53.528366 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: method: > Aug 06 14:23:53.528366 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: exception: Flavor 42 could not be found. Aug 06 14:23:53.528366 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: action_args: {'id': '42'} Aug 06 14:23:53.528366 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 14:23:53.528366 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:23:53.529219 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 06 14:23:53.529219 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 06 14:23:53.529219 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 06 14:23:53.529219 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 06 14:23:53.529219 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 14:23:53.529219 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 14:23:53.529219 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 06 14:23:53.529219 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 06 14:23:53.529219 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 06 14:23:53.529219 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 14:23:53.529219 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 06 14:23:53.529219 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 06 14:23:53.529219 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 06 14:23:53.529219 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi Aug 06 14:23:53.529219 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:23:53.529219 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi Aug 06 14:23:53.529219 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:23:53.529219 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:23:53.529219 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:23:53.530571 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 14:23:53.530571 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 14:23:53.530571 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 14:23:53.530571 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 14:23:53.530571 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 06 14:23:53.530571 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 06 14:23:53.530571 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 06 14:23:53.530571 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi Aug 06 14:23:53.530571 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:23:53.530571 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi Aug 06 14:23:53.530571 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:23:53.530571 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:23:53.530571 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:23:53.530571 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 14:23:53.530571 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 14:23:53.530571 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 06 14:23:53.530571 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi Aug 06 14:23:53.530571 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-c961c669-3649-43d5-8e59-7207e078157d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103174) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 14:23:53.531967 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.requestlog [None req-c961c669-3649-43d5-8e59-7207e078157d admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.390665 Aug 06 14:23:53.531967 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: [pid: 103174|app: 0|req: 20/39] 10.222.0.17 () {60 vars in 1190 bytes} [Sat Aug 6 14:23:53 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 06 14:23:53.537999 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-75db4b47-e4fa-4ae3-a050-e4ec24b0fd29 admin admin] Calling method '>' {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:23:53.542180 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG dbcounter [-] [103173] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:23:53.562079 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-75db4b47-e4fa-4ae3-a050-e4ec24b0fd29 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027556 Aug 06 14:23:53.562613 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 20/40] 10.222.0.17 () {60 vars in 1210 bytes} [Sat Aug 6 14:23:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:23:53.572416 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-84284404-e187-432a-87cf-09ae09c587ff admin admin] Calling method '>' {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:23:53.596273 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.requestlog [None req-84284404-e187-432a-87cf-09ae09c587ff admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027448 Aug 06 14:23:53.596803 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: [pid: 103174|app: 0|req: 21/41] 10.222.0.17 () {60 vars in 1210 bytes} [Sat Aug 6 14:23:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:23:53.607141 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-d8af1896-ae31-4a07-be71-db2597ff3ed5 admin admin] Calling method '>' {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:23:53.613299 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.wsgi [None req-d8af1896-ae31-4a07-be71-db2597ff3ed5 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 06 14:23:53.616552 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-d8af1896-ae31-4a07-be71-db2597ff3ed5 admin admin] Request method failure captured: Aug 06 14:23:53.616552 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 06 14:23:53.616552 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: Accept: application/json Aug 06 14:23:53.616552 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: Accept-Encoding: gzip, deflate Aug 06 14:23:53.616552 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: Connection: keep-alive Aug 06 14:23:53.616552 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: Content-Length: 0 Aug 06 14:23:53.616552 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: Host: 10.222.0.17 Aug 06 14:23:53.616552 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: Openstack-Api-Version: compute 2.90 Aug 06 14:23:53.616552 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: Openstack-System-Scope: None Aug 06 14:23:53.616552 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: User-Agent: python-novaclient Aug 06 14:23:53.616552 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: X-Auth-Token: gAAAAABi7nl4q1hGGi4mQiXmGag0JjMh1Zh6gIDCy__6wJNkJjekU06hjASTOKEdIjdySXTTMDh13WUX7TU81c_myhouSKrbP8NNTkzoF8SVTDn7_MWfGgnp1rBsfm6N-uc8tS7EuGZSuGAXKa61bsZA1ofIE4RxyWRTKyvHLbBska5jRAJwKxo Aug 06 14:23:53.616552 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: X-Domain-Id: None Aug 06 14:23:53.616552 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: X-Domain-Name: None Aug 06 14:23:53.616552 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: X-Identity-Status: Confirmed Aug 06 14:23:53.616552 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: X-Is-Admin-Project: True Aug 06 14:23:53.616552 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: X-Openstack-Nova-Api-Version: 2.90 Aug 06 14:23:53.616552 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: X-Project-Domain-Id: default Aug 06 14:23:53.616552 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: X-Project-Domain-Name: Default Aug 06 14:23:53.616552 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: X-Project-Id: 3509ae96075e47edbbf7f243bb4b1186 Aug 06 14:23:53.616552 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: X-Project-Name: admin Aug 06 14:23:53.616552 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: X-Role: member,admin,reader Aug 06 14:23:53.616552 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: X-Roles: member,admin,reader Aug 06 14:23:53.618038 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3509ae96075e47edbbf7f243bb4b1186"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3509ae96075e47edbbf7f243bb4b1186"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3509ae96075e47edbbf7f243bb4b1186", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3509ae96075e47edbbf7f243bb4b1186"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 06 14:23:53.618038 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: X-Tenant: admin Aug 06 14:23:53.618038 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: X-Tenant-Id: 3509ae96075e47edbbf7f243bb4b1186 Aug 06 14:23:53.618038 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: X-Tenant-Name: admin Aug 06 14:23:53.618038 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: X-User: admin Aug 06 14:23:53.618038 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: X-User-Domain-Id: default Aug 06 14:23:53.618038 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: X-User-Domain-Name: Default Aug 06 14:23:53.618038 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: X-User-Id: b7c86189492e4a4d8e62d6e2879b6ae2 Aug 06 14:23:53.618038 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: X-User-Name: admin Aug 06 14:23:53.618038 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: method: > Aug 06 14:23:53.618038 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: exception: Flavor 42 could not be found. Aug 06 14:23:53.618038 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: action_args: {'id': '42'} Aug 06 14:23:53.618038 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 14:23:53.618038 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:23:53.619168 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 06 14:23:53.619168 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 06 14:23:53.619168 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 06 14:23:53.619168 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 06 14:23:53.619168 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 14:23:53.619168 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 14:23:53.619168 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 06 14:23:53.619168 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 06 14:23:53.619168 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 06 14:23:53.619168 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 14:23:53.619168 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 06 14:23:53.619168 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 06 14:23:53.619168 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 06 14:23:53.619168 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi Aug 06 14:23:53.619168 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:23:53.619168 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi Aug 06 14:23:53.619168 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:23:53.619168 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:23:53.619168 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:23:53.620477 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 14:23:53.620477 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 14:23:53.620477 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 14:23:53.620477 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 14:23:53.620477 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 06 14:23:53.620477 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 06 14:23:53.620477 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 06 14:23:53.620477 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi Aug 06 14:23:53.620477 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:23:53.620477 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi Aug 06 14:23:53.620477 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:23:53.620477 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:23:53.620477 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:23:53.620477 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 14:23:53.620477 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 14:23:53.620477 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 06 14:23:53.620477 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi Aug 06 14:23:53.620477 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-d8af1896-ae31-4a07-be71-db2597ff3ed5 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103173) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 14:23:53.621689 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-d8af1896-ae31-4a07-be71-db2597ff3ed5 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015546 Aug 06 14:23:53.621689 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 21/42] 10.222.0.17 () {60 vars in 1190 bytes} [Sat Aug 6 14:23:53 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 06 14:23:54.573878 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-84284404-e187-432a-87cf-09ae09c587ff admin admin] Calling method '>' {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:23:54.574898 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.requestlog [None req-84284404-e187-432a-87cf-09ae09c587ff admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Aug 06 14:23:54.575306 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: [pid: 103174|app: 0|req: 22/43] 10.222.0.17 () {56 vars in 1074 bytes} [Sat Aug 6 14:23:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:23:55.098613 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-c4964524-ac56-4233-a886-f3eef276289b admin admin] Calling method '>' {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:23:55.106522 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.wsgi [None req-c4964524-ac56-4233-a886-f3eef276289b admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 06 14:23:55.108065 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-c4964524-ac56-4233-a886-f3eef276289b admin admin] Request method failure captured: Aug 06 14:23:55.108065 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 06 14:23:55.108065 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: Accept: application/json Aug 06 14:23:55.108065 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: Accept-Encoding: gzip, deflate Aug 06 14:23:55.108065 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: Connection: keep-alive Aug 06 14:23:55.108065 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: Content-Length: 0 Aug 06 14:23:55.108065 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: Host: 10.222.0.17 Aug 06 14:23:55.108065 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: Openstack-Api-Version: compute 2.90 Aug 06 14:23:55.108065 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: Openstack-System-Scope: None Aug 06 14:23:55.108065 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: User-Agent: python-novaclient Aug 06 14:23:55.108065 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: X-Auth-Token: gAAAAABi7nl64iQGRakmqUPkzRuJYDKpbNrCHGRf1Mf7Ansy1hwv3jYadJyKY5AK7fSaBsy2Ev_E7UDirJNTjX1HjgHZhgfcCIgMejPtuW3pSZ6KoGcyaKc2dEH2HAUs-FMlOL9kIYTfb53OCOLcS9JAo9Jn7gyfCRJh5bybaBO7K8ZfaghmpBE Aug 06 14:23:55.108065 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: X-Domain-Id: None Aug 06 14:23:55.108065 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: X-Domain-Name: None Aug 06 14:23:55.108065 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: X-Identity-Status: Confirmed Aug 06 14:23:55.108065 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: X-Is-Admin-Project: True Aug 06 14:23:55.108065 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: X-Openstack-Nova-Api-Version: 2.90 Aug 06 14:23:55.108065 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: X-Project-Domain-Id: default Aug 06 14:23:55.108065 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: X-Project-Domain-Name: Default Aug 06 14:23:55.108065 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: X-Project-Id: 3509ae96075e47edbbf7f243bb4b1186 Aug 06 14:23:55.108065 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: X-Project-Name: admin Aug 06 14:23:55.108065 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: X-Role: member,admin,reader Aug 06 14:23:55.108065 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: X-Roles: member,admin,reader Aug 06 14:23:55.109588 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3509ae96075e47edbbf7f243bb4b1186"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3509ae96075e47edbbf7f243bb4b1186"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3509ae96075e47edbbf7f243bb4b1186", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3509ae96075e47edbbf7f243bb4b1186"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 06 14:23:55.109588 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: X-Tenant: admin Aug 06 14:23:55.109588 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: X-Tenant-Id: 3509ae96075e47edbbf7f243bb4b1186 Aug 06 14:23:55.109588 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: X-Tenant-Name: admin Aug 06 14:23:55.109588 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: X-User: admin Aug 06 14:23:55.109588 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: X-User-Domain-Id: default Aug 06 14:23:55.109588 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: X-User-Domain-Name: Default Aug 06 14:23:55.109588 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: X-User-Id: b7c86189492e4a4d8e62d6e2879b6ae2 Aug 06 14:23:55.109588 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: X-User-Name: admin Aug 06 14:23:55.109588 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: method: > Aug 06 14:23:55.109588 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: exception: Flavor 84 could not be found. Aug 06 14:23:55.109588 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: action_args: {'id': '84'} Aug 06 14:23:55.109588 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 14:23:55.109588 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:23:55.110517 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 06 14:23:55.110517 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 06 14:23:55.110517 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 06 14:23:55.110517 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 06 14:23:55.110517 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 14:23:55.110517 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 14:23:55.110517 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 06 14:23:55.110517 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 06 14:23:55.110517 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 06 14:23:55.110517 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 14:23:55.110517 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 06 14:23:55.110517 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 06 14:23:55.110517 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 06 14:23:55.110517 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi Aug 06 14:23:55.110517 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:23:55.110517 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi Aug 06 14:23:55.110517 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:23:55.110517 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:23:55.110517 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:23:55.111918 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 14:23:55.111918 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 14:23:55.111918 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 14:23:55.111918 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 14:23:55.111918 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 06 14:23:55.111918 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 06 14:23:55.111918 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 06 14:23:55.111918 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi Aug 06 14:23:55.111918 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:23:55.111918 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi Aug 06 14:23:55.111918 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:23:55.111918 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:23:55.111918 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:23:55.111918 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 14:23:55.111918 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 14:23:55.111918 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 06 14:23:55.111918 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi Aug 06 14:23:55.111918 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-c4964524-ac56-4233-a886-f3eef276289b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103173) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 14:23:55.113152 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-c4964524-ac56-4233-a886-f3eef276289b admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.394915 Aug 06 14:23:55.113152 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 22/44] 10.222.0.17 () {60 vars in 1190 bytes} [Sat Aug 6 14:23:54 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 06 14:23:55.118977 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-5c40c9c3-73a8-4b8e-a621-368fd209b743 admin admin] Calling method '>' {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:23:55.133691 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.requestlog [None req-5c40c9c3-73a8-4b8e-a621-368fd209b743 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018262 Aug 06 14:23:55.134211 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: [pid: 103174|app: 0|req: 23/45] 10.222.0.17 () {60 vars in 1210 bytes} [Sat Aug 6 14:23:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:23:55.143389 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-2acac0a8-969e-4200-bbf5-824f701f906a admin admin] Calling method '>' {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:23:55.159038 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-2acac0a8-969e-4200-bbf5-824f701f906a admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019055 Aug 06 14:23:55.159581 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 23/46] 10.222.0.17 () {60 vars in 1210 bytes} [Sat Aug 6 14:23:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 14:23:55.169246 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-baed6228-203f-421f-bbfc-40e03075098b admin admin] Calling method '>' {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:23:55.174552 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.wsgi [None req-baed6228-203f-421f-bbfc-40e03075098b admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 06 14:23:55.176349 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-baed6228-203f-421f-bbfc-40e03075098b admin admin] Request method failure captured: Aug 06 14:23:55.176349 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 06 14:23:55.176349 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: Accept: application/json Aug 06 14:23:55.176349 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: Accept-Encoding: gzip, deflate Aug 06 14:23:55.176349 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: Connection: keep-alive Aug 06 14:23:55.176349 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: Content-Length: 0 Aug 06 14:23:55.176349 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: Host: 10.222.0.17 Aug 06 14:23:55.176349 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: Openstack-Api-Version: compute 2.90 Aug 06 14:23:55.176349 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: Openstack-System-Scope: None Aug 06 14:23:55.176349 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: User-Agent: python-novaclient Aug 06 14:23:55.176349 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: X-Auth-Token: gAAAAABi7nl64iQGRakmqUPkzRuJYDKpbNrCHGRf1Mf7Ansy1hwv3jYadJyKY5AK7fSaBsy2Ev_E7UDirJNTjX1HjgHZhgfcCIgMejPtuW3pSZ6KoGcyaKc2dEH2HAUs-FMlOL9kIYTfb53OCOLcS9JAo9Jn7gyfCRJh5bybaBO7K8ZfaghmpBE Aug 06 14:23:55.176349 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: X-Domain-Id: None Aug 06 14:23:55.176349 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: X-Domain-Name: None Aug 06 14:23:55.176349 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: X-Identity-Status: Confirmed Aug 06 14:23:55.176349 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: X-Is-Admin-Project: True Aug 06 14:23:55.176349 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: X-Openstack-Nova-Api-Version: 2.90 Aug 06 14:23:55.176349 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: X-Project-Domain-Id: default Aug 06 14:23:55.176349 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: X-Project-Domain-Name: Default Aug 06 14:23:55.176349 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: X-Project-Id: 3509ae96075e47edbbf7f243bb4b1186 Aug 06 14:23:55.176349 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: X-Project-Name: admin Aug 06 14:23:55.176349 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: X-Role: member,admin,reader Aug 06 14:23:55.176349 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: X-Roles: member,admin,reader Aug 06 14:23:55.177874 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3509ae96075e47edbbf7f243bb4b1186"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3509ae96075e47edbbf7f243bb4b1186"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3509ae96075e47edbbf7f243bb4b1186", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3509ae96075e47edbbf7f243bb4b1186"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 06 14:23:55.177874 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: X-Tenant: admin Aug 06 14:23:55.177874 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: X-Tenant-Id: 3509ae96075e47edbbf7f243bb4b1186 Aug 06 14:23:55.177874 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: X-Tenant-Name: admin Aug 06 14:23:55.177874 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: X-User: admin Aug 06 14:23:55.177874 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: X-User-Domain-Id: default Aug 06 14:23:55.177874 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: X-User-Domain-Name: Default Aug 06 14:23:55.177874 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: X-User-Id: b7c86189492e4a4d8e62d6e2879b6ae2 Aug 06 14:23:55.177874 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: X-User-Name: admin Aug 06 14:23:55.177874 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: method: > Aug 06 14:23:55.177874 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: exception: Flavor 84 could not be found. Aug 06 14:23:55.177874 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: action_args: {'id': '84'} Aug 06 14:23:55.177874 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 14:23:55.177874 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:23:55.178820 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 06 14:23:55.178820 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 06 14:23:55.178820 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 06 14:23:55.178820 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 06 14:23:55.178820 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 14:23:55.178820 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 14:23:55.178820 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 06 14:23:55.178820 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 06 14:23:55.178820 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 06 14:23:55.178820 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 14:23:55.178820 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 06 14:23:55.178820 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 06 14:23:55.178820 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 06 14:23:55.178820 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi Aug 06 14:23:55.178820 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:23:55.178820 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi Aug 06 14:23:55.178820 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:23:55.178820 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:23:55.178820 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:23:55.180120 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 14:23:55.180120 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 14:23:55.180120 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 14:23:55.180120 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 14:23:55.180120 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 06 14:23:55.180120 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 06 14:23:55.180120 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 06 14:23:55.180120 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi Aug 06 14:23:55.180120 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:23:55.180120 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi Aug 06 14:23:55.180120 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:23:55.180120 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:23:55.180120 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:23:55.180120 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 14:23:55.180120 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 14:23:55.180120 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 06 14:23:55.180120 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi Aug 06 14:23:55.180120 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-baed6228-203f-421f-bbfc-40e03075098b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103174) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 14:23:55.181543 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.requestlog [None req-baed6228-203f-421f-bbfc-40e03075098b admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012577 Aug 06 14:23:55.181543 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: [pid: 103174|app: 0|req: 24/47] 10.222.0.17 () {60 vars in 1190 bytes} [Sat Aug 6 14:23:55 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 06 14:23:56.134124 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-2acac0a8-969e-4200-bbf5-824f701f906a admin admin] Calling method '>' {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:23:56.135138 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-2acac0a8-969e-4200-bbf5-824f701f906a admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Aug 06 14:23:56.135530 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 24/48] 10.222.0.17 () {56 vars in 1074 bytes} [Sat Aug 6 14:23:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:23:56.658720 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-e203d4d7-09bd-4417-803a-d2318d90c03b admin admin] Calling method '>' {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:23:56.664413 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.wsgi [None req-e203d4d7-09bd-4417-803a-d2318d90c03b admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 06 14:23:56.665901 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-e203d4d7-09bd-4417-803a-d2318d90c03b admin admin] Request method failure captured: Aug 06 14:23:56.665901 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 06 14:23:56.665901 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: Accept: application/json Aug 06 14:23:56.665901 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: Accept-Encoding: gzip, deflate Aug 06 14:23:56.665901 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: Connection: keep-alive Aug 06 14:23:56.665901 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: Content-Length: 0 Aug 06 14:23:56.665901 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: Host: 10.222.0.17 Aug 06 14:23:56.665901 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: Openstack-Api-Version: compute 2.90 Aug 06 14:23:56.665901 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: Openstack-System-Scope: None Aug 06 14:23:56.665901 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: User-Agent: python-novaclient Aug 06 14:23:56.665901 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: X-Auth-Token: gAAAAABi7nl8Qtokfnr6fXzTlhreE9v-eVDBBN7IzWhuwB548VZUFDW_jp-I4kLVizWH7tHB0kHsG4tHsFIeji1q1OB25ZTHzxZ2NHcmlco_qFE90BqXWqsefcsEj8TwLSajhFrDWMoEkgiJ1Nb3yjvuOcs3eUUI2xXte8vE2B6wOA4aBPzObPE Aug 06 14:23:56.665901 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: X-Domain-Id: None Aug 06 14:23:56.665901 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: X-Domain-Name: None Aug 06 14:23:56.665901 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: X-Identity-Status: Confirmed Aug 06 14:23:56.665901 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: X-Is-Admin-Project: True Aug 06 14:23:56.665901 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: X-Openstack-Nova-Api-Version: 2.90 Aug 06 14:23:56.665901 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: X-Project-Domain-Id: default Aug 06 14:23:56.665901 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: X-Project-Domain-Name: Default Aug 06 14:23:56.665901 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: X-Project-Id: 3509ae96075e47edbbf7f243bb4b1186 Aug 06 14:23:56.665901 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: X-Project-Name: admin Aug 06 14:23:56.665901 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: X-Role: member,admin,reader Aug 06 14:23:56.665901 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: X-Roles: member,admin,reader Aug 06 14:23:56.668147 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3509ae96075e47edbbf7f243bb4b1186"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3509ae96075e47edbbf7f243bb4b1186"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3509ae96075e47edbbf7f243bb4b1186", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3509ae96075e47edbbf7f243bb4b1186"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 06 14:23:56.668147 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: X-Tenant: admin Aug 06 14:23:56.668147 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: X-Tenant-Id: 3509ae96075e47edbbf7f243bb4b1186 Aug 06 14:23:56.668147 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: X-Tenant-Name: admin Aug 06 14:23:56.668147 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: X-User: admin Aug 06 14:23:56.668147 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: X-User-Domain-Id: default Aug 06 14:23:56.668147 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: X-User-Domain-Name: Default Aug 06 14:23:56.668147 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: X-User-Id: b7c86189492e4a4d8e62d6e2879b6ae2 Aug 06 14:23:56.668147 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: X-User-Name: admin Aug 06 14:23:56.668147 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: method: > Aug 06 14:23:56.668147 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: exception: Flavor 451 could not be found. Aug 06 14:23:56.668147 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: action_args: {'id': '451'} Aug 06 14:23:56.668147 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 14:23:56.668147 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:23:56.668957 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 06 14:23:56.668957 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 06 14:23:56.668957 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 06 14:23:56.668957 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 06 14:23:56.668957 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 14:23:56.668957 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 14:23:56.668957 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 06 14:23:56.668957 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 06 14:23:56.668957 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 06 14:23:56.668957 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 14:23:56.668957 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 06 14:23:56.668957 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 06 14:23:56.668957 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 06 14:23:56.668957 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi Aug 06 14:23:56.668957 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:23:56.668957 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi Aug 06 14:23:56.668957 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:23:56.668957 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:23:56.668957 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:23:56.670297 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 14:23:56.670297 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 14:23:56.670297 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 14:23:56.670297 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 14:23:56.670297 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 06 14:23:56.670297 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 06 14:23:56.670297 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 06 14:23:56.670297 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi Aug 06 14:23:56.670297 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:23:56.670297 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi Aug 06 14:23:56.670297 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:23:56.670297 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:23:56.670297 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:23:56.670297 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 14:23:56.670297 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 14:23:56.670297 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 06 14:23:56.670297 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi Aug 06 14:23:56.670297 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-e203d4d7-09bd-4417-803a-d2318d90c03b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103174) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 14:23:56.671625 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.requestlog [None req-e203d4d7-09bd-4417-803a-d2318d90c03b admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.394186 Aug 06 14:23:56.671625 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: [pid: 103174|app: 0|req: 25/49] 10.222.0.17 () {60 vars in 1193 bytes} [Sat Aug 6 14:23:56 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 06 14:23:56.677651 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-aba717a9-a187-4fb7-ae6a-b163cf6bc349 admin admin] Calling method '>' {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:23:56.692395 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-aba717a9-a187-4fb7-ae6a-b163cf6bc349 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018448 Aug 06 14:23:56.692951 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 25/50] 10.222.0.17 () {60 vars in 1210 bytes} [Sat Aug 6 14:23:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:23:56.703666 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-ce6f88be-d743-404a-8ff5-23a890fc0ccf admin admin] Calling method '>' {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:23:56.719060 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.requestlog [None req-ce6f88be-d743-404a-8ff5-23a890fc0ccf admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019939 Aug 06 14:23:56.719580 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: [pid: 103174|app: 0|req: 26/51] 10.222.0.17 () {60 vars in 1210 bytes} [Sat Aug 6 14:23:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:23:56.728876 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-c69beda5-4713-44ca-a184-0c4884004ac3 admin admin] Calling method '>' {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:23:56.734932 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.wsgi [None req-c69beda5-4713-44ca-a184-0c4884004ac3 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 06 14:23:56.736429 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-c69beda5-4713-44ca-a184-0c4884004ac3 admin admin] Request method failure captured: Aug 06 14:23:56.736429 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 06 14:23:56.736429 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: Accept: application/json Aug 06 14:23:56.736429 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: Accept-Encoding: gzip, deflate Aug 06 14:23:56.736429 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: Connection: keep-alive Aug 06 14:23:56.736429 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: Content-Length: 0 Aug 06 14:23:56.736429 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: Host: 10.222.0.17 Aug 06 14:23:56.736429 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: Openstack-Api-Version: compute 2.90 Aug 06 14:23:56.736429 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: Openstack-System-Scope: None Aug 06 14:23:56.736429 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: User-Agent: python-novaclient Aug 06 14:23:56.736429 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: X-Auth-Token: gAAAAABi7nl8Qtokfnr6fXzTlhreE9v-eVDBBN7IzWhuwB548VZUFDW_jp-I4kLVizWH7tHB0kHsG4tHsFIeji1q1OB25ZTHzxZ2NHcmlco_qFE90BqXWqsefcsEj8TwLSajhFrDWMoEkgiJ1Nb3yjvuOcs3eUUI2xXte8vE2B6wOA4aBPzObPE Aug 06 14:23:56.736429 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: X-Domain-Id: None Aug 06 14:23:56.736429 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: X-Domain-Name: None Aug 06 14:23:56.736429 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: X-Identity-Status: Confirmed Aug 06 14:23:56.736429 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: X-Is-Admin-Project: True Aug 06 14:23:56.736429 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: X-Openstack-Nova-Api-Version: 2.90 Aug 06 14:23:56.736429 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: X-Project-Domain-Id: default Aug 06 14:23:56.736429 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: X-Project-Domain-Name: Default Aug 06 14:23:56.736429 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: X-Project-Id: 3509ae96075e47edbbf7f243bb4b1186 Aug 06 14:23:56.736429 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: X-Project-Name: admin Aug 06 14:23:56.736429 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: X-Role: member,admin,reader Aug 06 14:23:56.736429 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: X-Roles: member,admin,reader Aug 06 14:23:56.737689 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3509ae96075e47edbbf7f243bb4b1186"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/3509ae96075e47edbbf7f243bb4b1186"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_3509ae96075e47edbbf7f243bb4b1186", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/3509ae96075e47edbbf7f243bb4b1186"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 06 14:23:56.737689 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: X-Tenant: admin Aug 06 14:23:56.737689 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: X-Tenant-Id: 3509ae96075e47edbbf7f243bb4b1186 Aug 06 14:23:56.737689 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: X-Tenant-Name: admin Aug 06 14:23:56.737689 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: X-User: admin Aug 06 14:23:56.737689 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: X-User-Domain-Id: default Aug 06 14:23:56.737689 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: X-User-Domain-Name: Default Aug 06 14:23:56.737689 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: X-User-Id: b7c86189492e4a4d8e62d6e2879b6ae2 Aug 06 14:23:56.737689 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: X-User-Name: admin Aug 06 14:23:56.737689 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: method: > Aug 06 14:23:56.737689 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: exception: Flavor 451 could not be found. Aug 06 14:23:56.737689 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: action_args: {'id': '451'} Aug 06 14:23:56.737689 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 14:23:56.737689 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:23:56.738582 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 06 14:23:56.738582 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 06 14:23:56.738582 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 06 14:23:56.738582 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 06 14:23:56.738582 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 14:23:56.738582 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 14:23:56.738582 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 06 14:23:56.738582 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 06 14:23:56.738582 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 06 14:23:56.738582 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 14:23:56.738582 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 06 14:23:56.738582 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 06 14:23:56.738582 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 06 14:23:56.738582 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi Aug 06 14:23:56.738582 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:23:56.738582 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi Aug 06 14:23:56.738582 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:23:56.738582 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:23:56.738582 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:23:56.739901 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 14:23:56.739901 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 14:23:56.739901 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 14:23:56.739901 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 14:23:56.739901 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 06 14:23:56.739901 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 06 14:23:56.739901 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 06 14:23:56.739901 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi Aug 06 14:23:56.739901 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:23:56.739901 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi Aug 06 14:23:56.739901 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:23:56.739901 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:23:56.739901 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:23:56.739901 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 14:23:56.739901 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 14:23:56.739901 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 06 14:23:56.739901 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: ERROR nova.api.openstack.wsgi Aug 06 14:23:56.739901 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-c69beda5-4713-44ca-a184-0c4884004ac3 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103173) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 14:23:56.741162 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-c69beda5-4713-44ca-a184-0c4884004ac3 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012557 Aug 06 14:23:56.741162 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 26/52] 10.222.0.17 () {60 vars in 1193 bytes} [Sat Aug 6 14:23:56 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 06 14:23:57.692598 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-ce6f88be-d743-404a-8ff5-23a890fc0ccf admin admin] Calling method '>' {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:23:57.693603 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.requestlog [None req-ce6f88be-d743-404a-8ff5-23a890fc0ccf admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Aug 06 14:23:57.693995 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: [pid: 103174|app: 0|req: 27/53] 10.222.0.17 () {56 vars in 1074 bytes} [Sat Aug 6 14:23:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:23:58.219408 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-0b14de6d-6145-492a-be5b-3ac93503402f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:23:58.239175 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-0b14de6d-6145-492a-be5b-3ac93503402f admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.405777 Aug 06 14:23:58.239720 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 27/54] 10.222.0.17 () {64 vars in 1235 bytes} [Sat Aug 6 14:23:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 06 14:23:59.190040 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-ce6f88be-d743-404a-8ff5-23a890fc0ccf admin admin] Calling method '>' {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:23:59.191077 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.requestlog [None req-ce6f88be-d743-404a-8ff5-23a890fc0ccf admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Aug 06 14:23:59.191467 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: [pid: 103174|app: 0|req: 28/55] 10.222.0.17 () {56 vars in 1074 bytes} [Sat Aug 6 14:23:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:23:59.713861 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-f6822158-40ba-4f5b-91e0-0e3d43eb19dd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:23:59.731881 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-f6822158-40ba-4f5b-91e0-0e3d43eb19dd admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.402617 Aug 06 14:23:59.732356 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 28/56] 10.222.0.17 () {64 vars in 1235 bytes} [Sat Aug 6 14:23:59 2022] POST /compute/v2.1/flavors => generated 405 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 14:24:00.693228 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-ce6f88be-d743-404a-8ff5-23a890fc0ccf admin admin] Calling method '>' {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:24:00.694271 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.requestlog [None req-ce6f88be-d743-404a-8ff5-23a890fc0ccf admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Aug 06 14:24:00.694666 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: [pid: 103174|app: 0|req: 29/57] 10.222.0.17 () {56 vars in 1074 bytes} [Sat Aug 6 14:24:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:24:01.208786 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-553ec274-b087-496e-95c3-2c5c59bf6cf7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:24:01.227256 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-553ec274-b087-496e-95c3-2c5c59bf6cf7 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.394544 Aug 06 14:24:01.227823 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 29/58] 10.222.0.17 () {64 vars in 1235 bytes} [Sat Aug 6 14:24:00 2022] POST /compute/v2.1/flavors => generated 407 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 06 14:24:02.175620 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-ce6f88be-d743-404a-8ff5-23a890fc0ccf admin admin] Calling method '>' {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:24:02.176879 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.requestlog [None req-ce6f88be-d743-404a-8ff5-23a890fc0ccf admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001707 Aug 06 14:24:02.177275 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: [pid: 103174|app: 0|req: 30/59] 10.222.0.17 () {56 vars in 1074 bytes} [Sat Aug 6 14:24:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:24:02.707520 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-9def1f4d-992b-49d7-acf8-aedceb183a03 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:24:02.726503 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-9def1f4d-992b-49d7-acf8-aedceb183a03 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.411579 Aug 06 14:24:02.727004 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 30/60] 10.222.0.17 () {64 vars in 1235 bytes} [Sat Aug 6 14:24:02 2022] POST /compute/v2.1/flavors => generated 409 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 14:24:03.693098 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-ce6f88be-d743-404a-8ff5-23a890fc0ccf admin admin] Calling method '>' {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:24:03.694101 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.requestlog [None req-ce6f88be-d743-404a-8ff5-23a890fc0ccf admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Aug 06 14:24:03.694499 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: [pid: 103174|app: 0|req: 31/61] 10.222.0.17 () {56 vars in 1074 bytes} [Sat Aug 6 14:24:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:24:04.223405 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-ee07acd9-a16d-4131-8865-12400a265f7a admin admin] Calling method '>' {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:24:04.243807 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-ee07acd9-a16d-4131-8865-12400a265f7a admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.407927 Aug 06 14:24:04.244347 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 31/62] 10.222.0.17 () {60 vars in 1202 bytes} [Sat Aug 6 14:24:03 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:24:55.194247 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-ce6f88be-d743-404a-8ff5-23a890fc0ccf admin admin] Calling method '>' {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:24:55.195303 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.requestlog [None req-ce6f88be-d743-404a-8ff5-23a890fc0ccf admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Aug 06 14:24:55.195708 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: [pid: 103174|app: 0|req: 32/63] 10.222.0.17 () {54 vars in 931 bytes} [Sat Aug 6 14:24:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:24:55.206819 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG dbcounter [-] [103173] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:24:55.580037 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-c8f4bbb3-2106-40f0-9cad-6d9817712c71 admin admin] Calling method '>' {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:24:55.599895 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-c8f4bbb3-2106-40f0-9cad-6d9817712c71 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.397487 Aug 06 14:24:55.600425 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 32/64] 10.222.0.17 () {60 vars in 1292 bytes} [Sat Aug 6 14:24:55 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:24:55.624258 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-f88c8441-8acd-4b40-ab98-45430590849e admin admin] Calling method '>' {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:24:55.627662 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG dbcounter [-] [103174] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:24:55.633131 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.requestlog [None req-f88c8441-8acd-4b40-ab98-45430590849e admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012462 Aug 06 14:24:55.633642 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: [pid: 103174|app: 0|req: 33/65] 10.222.0.17 () {60 vars in 1283 bytes} [Sat Aug 6 14:24:55 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:24:55.645031 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-2e4fe2c1-b281-4e40-bb93-968b0c621637 admin admin] Calling method '>' {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:24:55.653152 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-2e4fe2c1-b281-4e40-bb93-968b0c621637 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011683 Aug 06 14:24:55.653659 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 33/66] 10.222.0.17 () {60 vars in 1286 bytes} [Sat Aug 6 14:24:55 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:24:55.665311 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-186da01d-39be-4528-8ffa-e4ba7534f2bb admin admin] Calling method '>' {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:24:55.673717 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.requestlog [None req-186da01d-39be-4528-8ffa-e4ba7534f2bb admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012515 Aug 06 14:24:55.674275 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: [pid: 103174|app: 0|req: 34/67] 10.222.0.17 () {60 vars in 1286 bytes} [Sat Aug 6 14:24:55 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:24:55.685787 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-c6a332b7-c77c-4286-a139-e99b15ac7cc7 admin admin] Calling method '>' {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:24:55.693111 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-c6a332b7-c77c-4286-a139-e99b15ac7cc7 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010842 Aug 06 14:24:55.693620 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 34/68] 10.222.0.17 () {60 vars in 1283 bytes} [Sat Aug 6 14:24:55 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:27:52.260273 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-186da01d-39be-4528-8ffa-e4ba7534f2bb admin admin] Calling method '>' {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:27:52.261301 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.requestlog [None req-186da01d-39be-4528-8ffa-e4ba7534f2bb admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001558 Aug 06 14:27:52.261691 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: [pid: 103174|app: 0|req: 35/69] 10.222.0.17 () {56 vars in 1074 bytes} [Sat Aug 6 14:27:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:27:52.400443 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG dbcounter [-] [103173] Writing DB stats nova_api:SELECT=6 {{(pid=103173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:27:52.558961 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-abbee072-5344-46c5-94fa-c6b29f940948 admin admin] Calling method '>' {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:27:52.561323 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 14:27:52.561323 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: warnings.warn(msg) Aug 06 14:27:52.562446 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG oslo_concurrency.lockutils [None req-abbee072-5344-46c5-94fa-c6b29f940948 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:27:52.562980 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG oslo_concurrency.lockutils [None req-abbee072-5344-46c5-94fa-c6b29f940948 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:27:52.563411 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG oslo_concurrency.lockutils [None req-abbee072-5344-46c5-94fa-c6b29f940948 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:27:52.564125 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG oslo_concurrency.lockutils [None req-abbee072-5344-46c5-94fa-c6b29f940948 admin admin] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:27:52.564568 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG oslo_concurrency.lockutils [None req-abbee072-5344-46c5-94fa-c6b29f940948 admin admin] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:27:52.564983 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG oslo_concurrency.lockutils [None req-abbee072-5344-46c5-94fa-c6b29f940948 admin admin] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:27:52.598585 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-abbee072-5344-46c5-94fa-c6b29f940948 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.199514 Aug 06 14:27:52.599605 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 35/70] 10.222.0.17 () {60 vars in 1193 bytes} [Sat Aug 6 14:27:52 2022] GET /compute/v2.1/os-services => generated 791 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 14:27:53.435646 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-186da01d-39be-4528-8ffa-e4ba7534f2bb admin admin] Calling method '>' {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:27:53.436641 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.requestlog [None req-186da01d-39be-4528-8ffa-e4ba7534f2bb admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Aug 06 14:27:53.437036 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: [pid: 103174|app: 0|req: 36/71] 10.222.0.17 () {56 vars in 1074 bytes} [Sat Aug 6 14:27:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:27:53.626501 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-20bf00e5-dc9f-4953-a8be-60cba31906c3 admin admin] Calling method '>' {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:27:53.628866 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 14:27:53.628866 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: warnings.warn(msg) Aug 06 14:27:53.629999 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG oslo_concurrency.lockutils [None req-20bf00e5-dc9f-4953-a8be-60cba31906c3 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:27:53.630474 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG oslo_concurrency.lockutils [None req-20bf00e5-dc9f-4953-a8be-60cba31906c3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:27:53.630919 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG oslo_concurrency.lockutils [None req-20bf00e5-dc9f-4953-a8be-60cba31906c3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:27:53.631631 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG oslo_concurrency.lockutils [None req-20bf00e5-dc9f-4953-a8be-60cba31906c3 admin admin] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:27:53.632075 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG oslo_concurrency.lockutils [None req-20bf00e5-dc9f-4953-a8be-60cba31906c3 admin admin] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:27:53.632490 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG oslo_concurrency.lockutils [None req-20bf00e5-dc9f-4953-a8be-60cba31906c3 admin admin] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:27:53.652103 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-20bf00e5-dc9f-4953-a8be-60cba31906c3 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076486 Aug 06 14:27:53.652585 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 36/72] 10.222.0.17 () {60 vars in 1193 bytes} [Sat Aug 6 14:27:53 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 14:28:04.904716 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-186da01d-39be-4528-8ffa-e4ba7534f2bb admin admin] Calling method '>' {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:28:04.905744 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.requestlog [None req-186da01d-39be-4528-8ffa-e4ba7534f2bb admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 Aug 06 14:28:04.906137 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: [pid: 103174|app: 0|req: 37/73] 10.222.0.17 () {56 vars in 1074 bytes} [Sat Aug 6 14:28:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:28:05.048419 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG dbcounter [-] [103173] Writing DB stats nova_cell0:SELECT=4 {{(pid=103173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:28:05.049131 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG dbcounter [-] [103173] Writing DB stats nova_cell1:SELECT=4 {{(pid=103173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:28:05.049740 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG dbcounter [-] [103173] Writing DB stats nova_api:SELECT=8 {{(pid=103173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:28:05.097157 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-4c934cd4-02a2-4e89-ab77-adf88837484a admin admin] Calling method '>' {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:28:05.099542 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 14:28:05.099542 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: warnings.warn(msg) Aug 06 14:28:05.100627 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG oslo_concurrency.lockutils [None req-4c934cd4-02a2-4e89-ab77-adf88837484a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:28:05.101096 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG oslo_concurrency.lockutils [None req-4c934cd4-02a2-4e89-ab77-adf88837484a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:28:05.101530 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG oslo_concurrency.lockutils [None req-4c934cd4-02a2-4e89-ab77-adf88837484a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:28:05.102552 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG oslo_concurrency.lockutils [None req-4c934cd4-02a2-4e89-ab77-adf88837484a admin admin] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:28:05.103010 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG oslo_concurrency.lockutils [None req-4c934cd4-02a2-4e89-ab77-adf88837484a admin admin] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:28:05.103978 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG oslo_concurrency.lockutils [None req-4c934cd4-02a2-4e89-ab77-adf88837484a admin admin] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:28:05.130467 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-4c934cd4-02a2-4e89-ab77-adf88837484a admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.086385 Aug 06 14:28:05.131065 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 37/74] 10.222.0.17 () {60 vars in 1193 bytes} [Sat Aug 6 14:28:05 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:28:05.956198 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-186da01d-39be-4528-8ffa-e4ba7534f2bb admin admin] Calling method '>' {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:28:05.957192 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.requestlog [None req-186da01d-39be-4528-8ffa-e4ba7534f2bb admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001393 Aug 06 14:28:05.957584 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: [pid: 103174|app: 0|req: 38/75] 10.222.0.17 () {56 vars in 1074 bytes} [Sat Aug 6 14:28:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:28:06.151203 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG nova.api.openstack.wsgi [None req-eb91d126-70a7-49bb-8e13-298f9565af1b admin admin] Calling method '>' {{(pid=103173) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:28:06.154051 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 06 14:28:06.154051 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: warnings.warn(msg) Aug 06 14:28:06.155181 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG oslo_concurrency.lockutils [None req-eb91d126-70a7-49bb-8e13-298f9565af1b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:28:06.155654 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG oslo_concurrency.lockutils [None req-eb91d126-70a7-49bb-8e13-298f9565af1b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:28:06.156078 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG oslo_concurrency.lockutils [None req-eb91d126-70a7-49bb-8e13-298f9565af1b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:28:06.156779 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG oslo_concurrency.lockutils [None req-eb91d126-70a7-49bb-8e13-298f9565af1b admin admin] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:28:06.157219 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG oslo_concurrency.lockutils [None req-eb91d126-70a7-49bb-8e13-298f9565af1b admin admin] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:28:06.157627 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: DEBUG oslo_concurrency.lockutils [None req-eb91d126-70a7-49bb-8e13-298f9565af1b admin admin] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103173) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:28:06.178619 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: INFO nova.api.openstack.requestlog [None req-eb91d126-70a7-49bb-8e13-298f9565af1b admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.079746 Aug 06 14:28:06.179481 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: [pid: 103173|app: 0|req: 38/76] 10.222.0.17 () {60 vars in 1193 bytes} [Sat Aug 6 14:28:06 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:29:02.160396 dv-cinder-851996-4-iscsi devstack@n-api.service[103172]: Sat Aug 6 14:29:02 2022 - graceful shutdown triggered... Aug 06 14:29:02.160533 dv-cinder-851996-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 06 14:29:02.161473 dv-cinder-851996-4-iscsi devstack@n-api.service[103173]: Gracefully killing worker 1 (pid: 103173)... Aug 06 14:29:02.161909 dv-cinder-851996-4-iscsi devstack@n-api.service[103174]: Gracefully killing worker 2 (pid: 103174)... Aug 06 14:29:03.162571 dv-cinder-851996-4-iscsi devstack@n-api.service[103172]: worker 1 buried after 1 seconds Aug 06 14:29:03.163119 dv-cinder-851996-4-iscsi devstack@n-api.service[103172]: worker 2 buried after 1 seconds Aug 06 14:29:03.163119 dv-cinder-851996-4-iscsi devstack@n-api.service[103172]: goodbye to uWSGI. Aug 06 14:29:03.164182 dv-cinder-851996-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 06 14:29:03.164742 dv-cinder-851996-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 06 14:29:03.167527 dv-cinder-851996-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 06 14:29:03.178250 dv-cinder-851996-4-iscsi devstack@n-api.service[117826]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 06 14:29:03.180551 dv-cinder-851996-4-iscsi devstack@n-api.service[117826]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Aug 6 14:29:03 2022] *** Aug 06 14:29:03.180551 dv-cinder-851996-4-iscsi devstack@n-api.service[117826]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 06 14:29:03.180551 dv-cinder-851996-4-iscsi devstack@n-api.service[117826]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 06 14:29:03.180551 dv-cinder-851996-4-iscsi devstack@n-api.service[117826]: nodename: dv-cinder-851996-4-iscsi Aug 06 14:29:03.180551 dv-cinder-851996-4-iscsi devstack@n-api.service[117826]: machine: x86_64 Aug 06 14:29:03.180551 dv-cinder-851996-4-iscsi devstack@n-api.service[117826]: clock source: unix Aug 06 14:29:03.180551 dv-cinder-851996-4-iscsi devstack@n-api.service[117826]: pcre jit disabled Aug 06 14:29:03.180551 dv-cinder-851996-4-iscsi devstack@n-api.service[117826]: detected number of CPU cores: 4 Aug 06 14:29:03.180551 dv-cinder-851996-4-iscsi devstack@n-api.service[117826]: current working directory: / Aug 06 14:29:03.180551 dv-cinder-851996-4-iscsi devstack@n-api.service[117826]: detected binary path: /usr/bin/uwsgi-core Aug 06 14:29:03.180551 dv-cinder-851996-4-iscsi devstack@n-api.service[117826]: your processes number limit is 47680 Aug 06 14:29:03.181305 dv-cinder-851996-4-iscsi devstack@n-api.service[117826]: your memory page size is 4096 bytes Aug 06 14:29:03.181305 dv-cinder-851996-4-iscsi devstack@n-api.service[117826]: detected max file descriptor number: 2048 Aug 06 14:29:03.181305 dv-cinder-851996-4-iscsi devstack@n-api.service[117826]: lock engine: pthread robust mutexes Aug 06 14:29:03.181305 dv-cinder-851996-4-iscsi devstack@n-api.service[117826]: thunder lock: enabled Aug 06 14:29:03.181305 dv-cinder-851996-4-iscsi devstack@n-api.service[117826]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 06 14:29:03.181305 dv-cinder-851996-4-iscsi devstack@n-api.service[117826]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 06 14:29:03.220598 dv-cinder-851996-4-iscsi devstack@n-api.service[117826]: Python main interpreter initialized at 0x558fe28059c0 Aug 06 14:29:03.220598 dv-cinder-851996-4-iscsi devstack@n-api.service[117826]: python threads support enabled Aug 06 14:29:03.220598 dv-cinder-851996-4-iscsi devstack@n-api.service[117826]: your server socket listen backlog is limited to 100 connections Aug 06 14:29:03.220598 dv-cinder-851996-4-iscsi devstack@n-api.service[117826]: your mercy for graceful operations on workers is 90 seconds Aug 06 14:29:03.220976 dv-cinder-851996-4-iscsi devstack@n-api.service[117826]: mapped 403077 bytes (393 KB) for 2 cores Aug 06 14:29:03.221057 dv-cinder-851996-4-iscsi devstack@n-api.service[117826]: *** Operational MODE: preforking *** Aug 06 14:29:03.221277 dv-cinder-851996-4-iscsi devstack@n-api.service[117826]: *** uWSGI is running in multiple interpreter mode *** Aug 06 14:29:03.221277 dv-cinder-851996-4-iscsi devstack@n-api.service[117826]: spawned uWSGI master process (pid: 117826) Aug 06 14:29:03.221467 dv-cinder-851996-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 06 14:29:03.222616 dv-cinder-851996-4-iscsi devstack@n-api.service[117826]: spawned uWSGI worker 1 (pid: 117837, cores: 1) Aug 06 14:29:03.222616 dv-cinder-851996-4-iscsi devstack@n-api.service[117826]: spawned uWSGI worker 2 (pid: 117838, cores: 1) Aug 06 14:29:03.222616 dv-cinder-851996-4-iscsi devstack@n-api.service[117826]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 06 14:29:03.890767 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 06 14:29:03.896010 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 06 14:29:05.035590 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 06 14:29:05.035590 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: from cryptography.utils import int_from_bytes Aug 06 14:29:05.036280 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 06 14:29:05.036280 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: from cryptography.utils import int_from_bytes Aug 06 14:29:05.050394 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 06 14:29:05.050394 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: from cryptography.utils import int_from_bytes Aug 06 14:29:05.052237 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 06 14:29:05.052237 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: from cryptography.utils import int_from_bytes Aug 06 14:29:07.347212 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 06 14:29:07.347786 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 06 14:29:07.348126 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 06 14:29:07.348373 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 06 14:29:07.348633 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 06 14:29:07.349026 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.349355 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.349683 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.350008 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.350343 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.350659 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.351009 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.351337 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.351667 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.351929 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.352249 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.352657 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851996-4-iscsi {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.352905 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.353217 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.354052 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.354379 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.354690 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.355038 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.355349 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.355858 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.357407 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.357407 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.357407 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.357407 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.357734 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.357818 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.358182 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.358457 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.358787 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.359122 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.359531 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851996-4-iscsi {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.359853 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.360172 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.360484 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.360904 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.361223 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.361533 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.361863 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.362221 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.362531 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.362849 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.363204 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.363527 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.363853 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.364161 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.364478 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.364799 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.365125 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.365458 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.365749 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.366006 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.366320 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.366656 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.367015 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.367347 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.367600 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.367854 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.368226 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.368506 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.368817 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.369153 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.370022 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.370336 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.370648 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.370991 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.371301 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.371610 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.371933 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.372263 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.372579 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.372888 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.373234 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.373614 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.373865 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.374175 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.374520 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.374845 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.375183 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.375537 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.375829 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.376141 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.376450 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.376716 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 06 14:29:07.377225 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.377385 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 06 14:29:07.377537 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.377537 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.377818 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 06 14:29:07.377957 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.378104 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 06 14:29:07.378245 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.378450 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 06 14:29:07.378611 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.378781 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.378998 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.379148 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.379299 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.379299 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.379593 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.379739 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.379889 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.380037 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.380193 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.380467 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.380624 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.380792 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.380943 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.381105 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.381278 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.381457 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.381612 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.381761 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.381913 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.382054 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.382215 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.382366 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.382515 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851996-4-iscsi {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.383331 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.383494 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.383667 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.383819 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.383968 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.384129 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.384278 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.384419 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.384568 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.384722 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.384963 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.385140 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.385369 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.385523 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.385679 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.385679 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.385963 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.386145 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.386296 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.386443 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.386592 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.386734 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.386920 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.387078 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.387233 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.387382 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.387530 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.387676 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.387676 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.387972 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.388121 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.388121 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.388448 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.388593 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.388593 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.388874 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.389013 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.389159 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.389307 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.389307 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.389593 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.389741 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.389741 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.390026 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851996-4-iscsi {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.390174 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.390328 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.390468 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.390607 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.390751 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.390923 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.391087 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.391087 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.391355 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.391504 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.391504 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.391793 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.391942 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.392092 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.392241 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.392389 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.392529 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.392677 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.392938 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.393570 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.393730 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.393872 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.394023 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.394183 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.394336 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.394477 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.394629 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.394777 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.394777 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.395187 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.395346 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.395579 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.395725 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.395725 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.396000 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.396167 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.396167 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.396444 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.396583 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.396723 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.396862 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.397016 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.397167 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.397310 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.397456 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.397597 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.397745 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.397893 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.398055 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.398197 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.398348 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.398537 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.398693 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.398842 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.399063 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.399213 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.399213 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.399506 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.399647 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.399787 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.399945 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.400094 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.400242 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.400410 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.400564 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.400792 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.400946 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.401087 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.401229 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.401383 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.401526 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.401665 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.401861 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.402006 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.402153 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.402306 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.402448 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.402587 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.402727 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.403027 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.403214 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.403978 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.404136 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.404277 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.404417 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.404568 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.404719 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.404859 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.405017 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.405244 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.405397 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.405565 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.405881 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.406036 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.406185 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.406326 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.406474 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.406615 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.406785 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.406986 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.407141 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.407289 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.407438 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.407597 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.407748 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.407898 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.408047 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.408198 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.408346 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.408500 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.408710 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.408861 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.408861 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.409129 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.409267 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.409419 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.409419 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.409691 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.409840 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.410024 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.410165 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.410313 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.410453 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.410610 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.410800 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.410964 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.411117 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.411265 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.411413 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.411554 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.411702 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.411841 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.412031 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.412189 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.412495 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.412639 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.412639 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.412926 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.413161 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.413309 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.414064 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.414216 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.414467 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.414625 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.414776 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.414958 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.415115 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.415288 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.415598 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.415838 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.416481 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.416724 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.416874 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.417023 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.417165 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.417313 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.417514 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.417682 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.417824 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.417972 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.418120 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.418272 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.418423 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.418563 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.418742 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.418935 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.419094 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.419244 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.419385 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.419525 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.419671 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.419826 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.419973 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.420123 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.420274 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.420416 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.420562 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.420714 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.420862 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.421010 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.421157 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.421297 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.421445 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.421602 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.421750 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.421897 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.422036 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.422193 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.422341 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.422492 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.422650 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.422800 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.422960 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.423192 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.423366 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.423517 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.423960 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.424393 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.424553 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.424695 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.424856 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.424999 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.425139 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.425288 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.425428 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.425664 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.425823 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.426055 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.426203 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.426345 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.426529 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.426683 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.426683 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.427021 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.427166 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.427166 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 06 14:29:07.427439 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.427439 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.427724 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.427870 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.427870 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.428135 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.428274 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.428274 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.428555 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.428715 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.428906 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.429045 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.429045 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.429334 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.429483 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.429483 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.430002 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.430002 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.430288 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.430437 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.430437 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.430709 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.430928 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.430928 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.431225 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.431225 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.431500 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.431653 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.432508 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.432658 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.432658 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.432955 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.433095 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.433339 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.433488 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.433488 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.434085 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.434444 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.434604 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.434754 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.434935 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.435092 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.435396 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.435549 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.435708 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.435928 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.436097 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.436343 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.436497 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.436646 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.436794 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.436935 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.437084 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.437233 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.437373 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.437520 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.437662 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.437662 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.437926 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.438074 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.438233 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.438374 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.438513 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.438652 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.438790 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.439008 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.439168 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.439317 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.439457 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.439603 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.439758 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.440025 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.440169 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.440169 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.440457 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.440603 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.440753 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.441000 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.441156 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.441299 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.441439 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.441578 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.441731 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.441971 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.442114 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.442260 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.442425 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.442566 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.442784 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.442970 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.443125 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.443265 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.443546 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.443706 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.443952 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.444315 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.444641 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.444798 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.444952 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.445106 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.445256 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.445396 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.445536 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.445682 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.445831 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.446067 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.446216 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.446451 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.446608 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.446758 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.446967 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.447142 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.447319 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.447473 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.447624 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.447772 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.447921 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.450420 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.450616 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.450772 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.451023 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.451023 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.451023 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.451023 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.451600 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.451754 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.451903 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.452045 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.452195 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.452195 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.452465 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.452604 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.452744 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.452884 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.452884 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.453176 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.453176 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.453176 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.453715 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.453860 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.453860 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.454958 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.455125 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.455268 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.455424 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.455581 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.455731 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.455731 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.456014 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.456256 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.456431 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.456431 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.456817 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.457100 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.457100 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.457384 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.457524 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.457681 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.457898 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.458042 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.458182 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.458323 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.458490 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.458633 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.458779 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.458989 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.459136 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.459277 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.459430 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.459580 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.459580 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.459580 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.459580 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.459580 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.460239 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.460447 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.460601 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.460759 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.460907 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.461048 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.461197 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.461506 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.461805 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.461983 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.462150 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.462400 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.462581 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.462740 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.462947 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.463110 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.463261 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.463417 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.463574 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.463792 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.463792 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.464291 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.464450 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.464625 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.465292 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.465463 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.465614 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.465773 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.465929 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.466172 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.466425 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.466589 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.466840 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.467102 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.467269 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.467445 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.467725 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.467937 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.468085 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.468243 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.468405 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.468553 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.468708 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.468868 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.469100 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.469257 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.469413 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.469561 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.469707 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.469852 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.470008 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.470164 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.470331 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.470524 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.470678 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.470841 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.471061 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.471312 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.471555 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.471718 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.471874 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.472036 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.472191 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.472345 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.472500 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.472658 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.472814 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.473016 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.473177 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.473348 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.473507 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.473654 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.473925 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.474097 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.474301 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.474454 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.474601 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.474747 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.475199 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.475520 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.475669 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.475816 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.475972 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.476120 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.476276 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.476439 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.476657 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.478308 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.484385 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.484603 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.484772 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.484925 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.484925 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.485295 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.485488 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.485652 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.485809 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.485809 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.486117 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.486267 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.486267 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.486601 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.486771 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.486771 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.487166 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.487324 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.487474 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.487628 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.487628 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.487928 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.487928 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.488245 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.488421 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.488421 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.488421 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.488421 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.488421 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.489268 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.489268 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.489559 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.489714 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.489872 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.490133 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.490305 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.490462 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.490990 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.491156 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.491333 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.491483 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.491633 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.491869 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.492232 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.492340 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.492418 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.492543 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.492629 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.492700 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.492770 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.492855 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.492935 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.493020 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.493101 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.493101 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.493101 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.493296 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.498940 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.499056 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.499298 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.499427 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.499521 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.499618 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.499712 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.499804 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.499897 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.499981 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.500064 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.500155 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.500248 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.500332 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.500421 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.500504 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.500601 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.500706 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.500796 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.500887 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.500979 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.501061 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.501152 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.501242 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.501327 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.501416 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.501501 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.501590 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.501686 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.501686 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.501853 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.501938 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.502027 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.502111 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.502227 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.502321 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.502414 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.503115 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.503465 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.503702 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.503817 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.504034 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.504131 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.504318 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.504412 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.504592 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.504730 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.504730 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.504889 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.505091 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.505337 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.505337 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.505726 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.505814 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.505905 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.505905 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.506068 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.506153 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.506243 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.506243 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.506402 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.506500 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.506584 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.506673 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.506763 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.506854 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.506964 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.507063 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.507148 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.507148 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.507289 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.507377 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.507469 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.507564 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.507649 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.507731 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.509227 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.509326 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.509411 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.509502 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.509502 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.509663 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.509761 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.509761 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.510065 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.510226 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.510226 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.510439 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.510525 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.510525 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.510847 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.511018 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.511185 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.511185 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.511185 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.511185 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.511185 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.511185 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.511711 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.511806 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.511806 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.511806 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.512352 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.512450 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.512450 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.512450 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.512450 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.512450 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.512870 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.513128 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.513281 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.513387 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.513499 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.513602 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.513750 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.513834 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.513917 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.514032 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.514032 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.514032 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.514032 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.514429 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.514516 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.514516 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.514516 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.514711 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.514942 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.514942 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.515367 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.515471 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.515471 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.515599 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.515669 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.515669 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.515808 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.515881 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.515881 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.515881 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.516057 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.516160 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.516255 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.516340 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.516430 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.516517 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.516595 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.516688 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.516772 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.516890 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.516990 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.516990 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.516990 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.516990 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.517384 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.517476 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.517708 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.517798 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.518032 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.518122 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.518355 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.518474 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.518673 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.518755 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.523384 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.523579 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.523676 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.523763 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.523763 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.523925 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.524024 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.524110 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.524202 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.524286 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.524368 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.524368 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.524368 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.524368 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.524368 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.524368 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.524368 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.524870 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.524962 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.524962 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.525112 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.525202 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.525292 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.526123 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.526237 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.526325 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.526407 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.526490 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.526571 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.526667 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.526758 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.526843 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.527150 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.527258 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.527345 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.527472 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.527634 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.527738 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.527832 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.528191 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.528298 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.528298 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.528491 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.528588 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.528588 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.528588 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.528805 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.528903 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.529124 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.530062 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.530062 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.531125 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.531242 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.531319 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.531387 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.531387 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.531528 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.531623 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.531696 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.531771 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.531874 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.532030 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.532132 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.532132 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.532362 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.532460 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.532552 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.532689 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.532823 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.532979 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.533298 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.533389 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.533623 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.533943 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.534042 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.534275 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.534372 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.534607 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.534707 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.534993 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.535101 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.536636 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.536746 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.536834 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.536925 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.537009 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.537103 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.537187 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.537269 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.537350 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.537432 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.537523 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.537621 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.537705 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.537789 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.537880 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.537972 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.538069 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.538161 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.538245 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.538368 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.538525 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.538624 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.538836 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.538938 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.539170 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.539262 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.539486 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.540064 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.540174 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.540269 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.540354 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.540437 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.540526 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.540610 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.540756 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.540891 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.541036 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.541833 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.541936 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.542174 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.542278 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.542505 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.542600 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.542819 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.542948 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.543177 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.543271 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.543488 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.543588 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.543808 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.543904 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.544127 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.544226 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.544448 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.544537 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.544772 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.544877 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.545088 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.545179 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.545410 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.545508 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.545722 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.545818 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.546035 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.546128 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.546347 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.546468 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.546658 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.546839 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.547000 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.547103 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.547320 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.547425 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.547638 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.547730 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.547966 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.548057 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.548283 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.548380 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.548605 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.548752 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.548914 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.549024 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.549228 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.549344 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.549546 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.549650 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.549859 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.549962 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.550183 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.550305 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.550495 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.550626 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.550804 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.550971 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.551149 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.551288 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.551460 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.551608 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.551771 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.551934 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.552080 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.552393 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.552495 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.552703 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.552978 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.553094 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.553304 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.553535 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.553639 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.553924 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.554255 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.554401 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.554829 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.555135 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.555243 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.555464 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.555662 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.555827 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.555997 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.556162 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.556328 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.556727 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.556889 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.557073 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.557200 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.557290 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.557386 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.557473 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.557671 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.557992 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.558086 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.558313 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.558551 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.558645 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.558901 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.559013 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.559252 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.559353 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.559583 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.559684 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.559898 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.559996 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.560218 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.560402 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.560537 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.560735 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.560907 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.561049 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.561416 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.561556 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.561828 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.562005 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.562191 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.562326 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.562563 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.562696 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.562835 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.563016 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.563159 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.563290 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.563426 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.563563 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.563692 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.563819 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.563957 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.564128 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.564269 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.564474 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.564621 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.565235 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.565384 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.565519 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.565647 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.565777 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.565913 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.566059 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.566196 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.566334 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.566473 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.566611 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.566747 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.566923 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.567056 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.567186 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.567314 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.567442 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.567589 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.567727 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.567856 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.567983 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.568112 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.568272 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.568416 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.568591 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.568731 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.568907 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.569047 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.569222 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.569367 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.569536 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.569669 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.569851 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.569992 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.570198 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.570345 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.570985 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.571138 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.571279 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.571417 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.571555 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.571686 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.571842 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.572059 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.572192 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.572388 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.572530 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.572661 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.572788 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.572906 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.573032 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.573158 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.573321 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.573460 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.573576 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.573702 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.573702 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.573965 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.574101 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.574229 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.574364 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.574501 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.574630 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.574770 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.575072 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.575220 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.575392 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.575663 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.575796 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.576029 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.576231 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.576362 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.576633 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.576803 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.576942 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.577246 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.577377 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.577553 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.577878 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.578007 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.578192 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.578332 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.578499 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.578746 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.579034 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.579178 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.579317 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.579605 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.579749 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.580008 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.580209 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.580332 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.580642 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.580773 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.580968 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.581129 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.581326 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.581491 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.581630 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.582476 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.582624 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.582763 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.582944 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.582944 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.583616 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.583752 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.583883 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.584017 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.584153 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.584290 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.584426 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.584553 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.584680 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.584806 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.584933 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.585068 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.585196 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.585327 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.585463 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.585597 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.585733 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.585860 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.585987 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.586112 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.586237 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.586371 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.586517 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.586644 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.586777 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.586919 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.587049 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.587193 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.587330 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.587469 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.587605 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.587731 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.588363 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.588506 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.588644 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.588771 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.588897 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.589022 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.589022 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.589274 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.589409 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.589543 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.589669 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.589802 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.589944 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.590080 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.590210 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.590335 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.590461 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.590610 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.591094 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.591255 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.591463 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.591594 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.591729 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.591864 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.591990 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.592129 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.592265 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.592400 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.592567 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.592698 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.592841 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.592978 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.593106 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.593233 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.593361 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.593619 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.593758 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.593937 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.594078 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.594267 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.594480 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.594623 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.594825 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.594998 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.595180 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.595326 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.595528 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.595667 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.595844 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.595981 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.596163 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.596299 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.596476 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.596613 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.596790 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.596920 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.597105 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.597291 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.597465 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.597612 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.597750 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.597888 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.598017 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.598326 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.598465 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.598640 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.598979 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.599114 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.599298 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.599614 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.599761 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.599925 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.600176 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.600316 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.600535 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.600761 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.601380 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.601692 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.601836 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.601975 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.602154 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.602154 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.602533 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.602700 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.602838 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.602992 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.602992 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.603249 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.603383 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.603383 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.604157 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.604284 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.604413 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.604550 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.604679 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.605408 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.605557 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.605695 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.605834 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.605973 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.606110 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.606246 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.606377 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.606504 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.606646 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.606783 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.606938 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.607069 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.607198 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.607325 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.607467 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.607597 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.607725 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.607851 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.607979 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.608119 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.608249 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.608430 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.608570 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.608757 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.609015 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.609157 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.609366 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.609506 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.609726 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.609857 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.609984 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.610123 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.610327 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.610460 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.610659 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.610791 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.611012 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.611544 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.611813 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.611968 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.612080 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.612328 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.612567 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.612849 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.612975 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.613088 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.613216 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.613353 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.613523 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.613684 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.613819 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.613955 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.614083 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.614211 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.614345 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.614474 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.614667 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.614804 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.614957 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.615101 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.615229 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.615229 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.615470 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.615597 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.615759 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.615901 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.616030 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.616163 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.616291 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.616434 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.616572 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.616758 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.616892 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.617018 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.617145 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.617279 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.617416 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.617553 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.617683 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.617809 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.617943 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.618078 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.618220 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.618349 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.618485 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.618613 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.618783 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.618980 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.619137 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.619265 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.619399 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.619526 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.619651 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.619857 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.620002 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.620131 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.620259 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.620386 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.620612 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.620865 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.621014 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.621342 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.621637 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.621790 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.622005 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.622147 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.622277 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.622479 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.622610 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.622792 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.623100 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.623249 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.623432 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.623563 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.623745 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.623872 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.624058 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.624191 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.624369 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.624488 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.626904 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.627046 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.627148 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.627148 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.627322 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.627401 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.627401 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.627545 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.627633 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.627716 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.627796 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.627877 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.627957 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.628037 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.628117 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.628191 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.628261 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.628341 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.628420 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.628493 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.628582 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.628657 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.628727 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.628798 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.628868 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.629010 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.629114 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.629312 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.629410 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.629623 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.629707 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.629941 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.630034 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.630259 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.630344 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.630587 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.630671 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.630936 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.631039 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.631257 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.631367 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.631585 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.631831 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.631938 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.632247 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.632341 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.632562 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.632656 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.632907 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.633013 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.633237 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.633376 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.633605 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.633714 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.633865 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.633967 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.634171 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.634265 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.634418 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117838) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 06 14:29:07.634514 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.634834 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.635184 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.635504 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.635826 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.636147 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.636467 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.636791 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.637111 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.637428 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.637747 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.638065 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.638386 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.638704 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.639121 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.639452 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.639810 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.640138 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.640467 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.640791 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.641119 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.641438 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.641757 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.642073 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.642397 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.642722 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.643234 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.643855 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.644541 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.645305 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.645735 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.646463 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.646906 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.647234 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.647581 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.647924 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.648289 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.648886 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.649501 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.650100 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.651017 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.651370 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.651818 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.652148 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.652469 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.652794 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.653118 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.653450 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.653771 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.654085 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.654393 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.654710 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.655048 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.655460 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.655672 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.655984 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.656300 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.656609 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.656920 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.657423 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.657743 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.658058 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.658371 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.658689 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.659026 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.659344 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.659654 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.659966 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.660274 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.660623 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.660963 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.661285 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.661616 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.661937 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.662269 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.662588 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.662950 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.663283 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.663616 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.663934 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.664276 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.664593 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.664912 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.665230 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.665663 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.665857 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.666816 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.667189 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.667527 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.667845 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.668181 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.668508 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.668843 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.669170 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.669489 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.669995 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.670599 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.671198 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.671778 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.672358 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.672861 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.673460 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.673830 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.674164 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.674501 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.674842 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.675473 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.676095 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.676688 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.677166 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.677517 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.677890 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.679842 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.679842 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.679842 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.679842 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.680168 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.680248 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 06 14:29:07.680487 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117837) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 06 14:29:07.785914 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO dbcounter [None req-271f0401-95a4-4317-8353-a6a574723b9a None None] Registered counter for database nova_api Aug 06 14:29:07.807151 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_db.sqlalchemy.engines [None req-271f0401-95a4-4317-8353-a6a574723b9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117838) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 14:29:07.814296 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writer thread running {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 14:29:07.845143 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO dbcounter [None req-31bb1d6a-0624-49bd-9f42-01bdfa699346 None None] Registered counter for database nova_api Aug 06 14:29:07.868156 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_db.sqlalchemy.engines [None req-31bb1d6a-0624-49bd-9f42-01bdfa699346 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117837) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 14:29:07.872189 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.context [None req-271f0401-95a4-4317-8353-a6a574723b9a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fd953adc-bbd7-49ea-a6a5-a2e44aba103c(cell1) {{(pid=117838) load_cells /opt/stack/nova/nova/context.py:464}} Aug 06 14:29:07.874947 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writer thread running {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 14:29:07.876246 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-271f0401-95a4-4317-8353-a6a574723b9a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:29:07.876726 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-271f0401-95a4-4317-8353-a6a574723b9a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:29:07.878284 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-271f0401-95a4-4317-8353-a6a574723b9a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:29:07.879064 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-271f0401-95a4-4317-8353-a6a574723b9a None None] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:29:07.879516 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-271f0401-95a4-4317-8353-a6a574723b9a None None] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:29:07.881540 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-271f0401-95a4-4317-8353-a6a574723b9a None None] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:29:07.883563 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO dbcounter [None req-271f0401-95a4-4317-8353-a6a574723b9a None None] Registered counter for database nova_cell0 Aug 06 14:29:07.887767 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO dbcounter [None req-271f0401-95a4-4317-8353-a6a574723b9a None None] Registered counter for database nova_cell1 Aug 06 14:29:07.895011 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_db.sqlalchemy.engines [None req-271f0401-95a4-4317-8353-a6a574723b9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117838) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 14:29:07.897314 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_db.sqlalchemy.engines [None req-271f0401-95a4-4317-8353-a6a574723b9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117838) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 14:29:07.903645 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writer thread running {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 14:29:07.904943 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writer thread running {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 14:29:07.934996 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.context [None req-31bb1d6a-0624-49bd-9f42-01bdfa699346 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fd953adc-bbd7-49ea-a6a5-a2e44aba103c(cell1) {{(pid=117837) load_cells /opt/stack/nova/nova/context.py:464}} Aug 06 14:29:07.939061 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-31bb1d6a-0624-49bd-9f42-01bdfa699346 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:29:07.939537 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-31bb1d6a-0624-49bd-9f42-01bdfa699346 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:29:07.941087 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-31bb1d6a-0624-49bd-9f42-01bdfa699346 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:29:07.941821 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-31bb1d6a-0624-49bd-9f42-01bdfa699346 None None] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:29:07.942268 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-31bb1d6a-0624-49bd-9f42-01bdfa699346 None None] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:29:07.944283 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-31bb1d6a-0624-49bd-9f42-01bdfa699346 None None] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:29:07.946340 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO dbcounter [None req-31bb1d6a-0624-49bd-9f42-01bdfa699346 None None] Registered counter for database nova_cell0 Aug 06 14:29:07.951661 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO dbcounter [None req-31bb1d6a-0624-49bd-9f42-01bdfa699346 None None] Registered counter for database nova_cell1 Aug 06 14:29:07.959026 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_db.sqlalchemy.engines [None req-31bb1d6a-0624-49bd-9f42-01bdfa699346 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117837) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 14:29:07.960306 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_db.sqlalchemy.engines [None req-31bb1d6a-0624-49bd-9f42-01bdfa699346 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117837) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 14:29:07.967604 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writer thread running {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 14:29:08.049531 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO dbcounter [None req-271f0401-95a4-4317-8353-a6a574723b9a None None] Registered counter for database nova_cell0 Aug 06 14:29:08.058699 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_db.sqlalchemy.engines [None req-271f0401-95a4-4317-8353-a6a574723b9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117838) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 14:29:08.063418 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writer thread running {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 14:29:08.107822 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writer thread running {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 14:29:08.117897 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO dbcounter [None req-31bb1d6a-0624-49bd-9f42-01bdfa699346 None None] Registered counter for database nova_cell0 Aug 06 14:29:08.125464 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_db.sqlalchemy.engines [None req-31bb1d6a-0624-49bd-9f42-01bdfa699346 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117837) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 06 14:29:08.130197 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writer thread running {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 06 14:29:08.381397 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: WARNING keystonemiddleware.auth_token [None req-271f0401-95a4-4317-8353-a6a574723b9a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 06 14:29:08.389295 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: WARNING keystonemiddleware.auth_token [None req-271f0401-95a4-4317-8353-a6a574723b9a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 06 14:29:08.448073 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: WARNING keystonemiddleware.auth_token [None req-31bb1d6a-0624-49bd-9f42-01bdfa699346 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 06 14:29:08.455865 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: WARNING keystonemiddleware.auth_token [None req-31bb1d6a-0624-49bd-9f42-01bdfa699346 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 06 14:29:08.730703 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: WARNING keystonemiddleware.auth_token [None req-271f0401-95a4-4317-8353-a6a574723b9a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 06 14:29:08.736756 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: WARNING keystonemiddleware.auth_token [None req-271f0401-95a4-4317-8353-a6a574723b9a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 06 14:29:08.743082 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558fe28059c0 pid: 117838 (default app) Aug 06 14:29:08.796039 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: WARNING keystonemiddleware.auth_token [None req-31bb1d6a-0624-49bd-9f42-01bdfa699346 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 06 14:29:08.801972 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: WARNING keystonemiddleware.auth_token [None req-31bb1d6a-0624-49bd-9f42-01bdfa699346 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 06 14:29:08.808344 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558fe28059c0 pid: 117837 (default app) Aug 06 14:29:43.085518 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_api:SELECT=3 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:29:43.086041 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_cell1:SELECT=3 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:29:43.088401 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_cell0:SELECT=3 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:29:43.089066 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_cell0:SELECT=3 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:29:44.100923 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_api:SELECT=3 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:29:44.101610 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_cell1:SELECT=3 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:29:44.102326 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_cell0:SELECT=3 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:29:44.103255 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_cell0:SELECT=3 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:29:44.691669 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-d46cde18-a790-444f-916a-6fd2241332fb tempest-VolumesSnapshotsTestJSON-535569422 tempest-VolumesSnapshotsTestJSON-535569422-project] Action: 'create', calling method: .version_select at 0x7fbab34d4dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1702028631"}} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:29:44.924680 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-e5f22761-4005-49cb-9f74-a41626f9a591 tempest-VolumesNegativeTest-57650260 tempest-VolumesNegativeTest-57650260-project] Action: 'create', calling method: .version_select at 0x7fbab34d4dc0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-355106248", "metadata": {"Type": "work"}}} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:29:44.945927 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-e5f22761-4005-49cb-9f74-a41626f9a591 tempest-VolumesNegativeTest-57650260 tempest-VolumesNegativeTest-57650260-project] Request method failure captured: Aug 06 14:29:44.945927 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 06 14:29:44.945927 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Accept: application/json Aug 06 14:29:44.945927 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Accept-Encoding: identity Aug 06 14:29:44.945927 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Connection: close Aug 06 14:29:44.945927 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Content-Length: 121 Aug 06 14:29:44.945927 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Content-Type: application/json Aug 06 14:29:44.945927 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Host: 10.222.0.17 Aug 06 14:29:44.945927 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Openstack-System-Scope: None Aug 06 14:29:44.945927 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: User-Agent: python-urllib3/1.26.11 Aug 06 14:29:44.945927 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Auth-Token: gAAAAABi7nrXr5FhguppuqpLjRin7ACV2EqPNQGjMzdur-5IKMd5ATGH_bxbgGllIC0edRUX2L3UTM7sCCoNqCFe_ivVJtsU_P8xXKs6LeUbNvjZooFkyC6uxWdO4MxgcmmK4kjqFNDfDp2yvuEq5fAHQxwZCyyn8pX39bfJ0B2A8U-lCzarzPo Aug 06 14:29:44.945927 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Domain-Id: None Aug 06 14:29:44.945927 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Domain-Name: None Aug 06 14:29:44.945927 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Identity-Status: Confirmed Aug 06 14:29:44.945927 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Is-Admin-Project: True Aug 06 14:29:44.945927 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Domain-Id: default Aug 06 14:29:44.945927 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Domain-Name: Default Aug 06 14:29:44.945927 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Id: cd365cea868b4d9f8b9445569fd1e470 Aug 06 14:29:44.945927 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Name: tempest-VolumesNegativeTest-57650260 Aug 06 14:29:44.945927 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Role: member,reader Aug 06 14:29:44.945927 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Roles: member,reader Aug 06 14:29:44.947774 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cd365cea868b4d9f8b9445569fd1e470"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cd365cea868b4d9f8b9445569fd1e470"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cd365cea868b4d9f8b9445569fd1e470", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cd365cea868b4d9f8b9445569fd1e470"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 06 14:29:44.947774 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant: tempest-VolumesNegativeTest-57650260 Aug 06 14:29:44.947774 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant-Id: cd365cea868b4d9f8b9445569fd1e470 Aug 06 14:29:44.947774 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant-Name: tempest-VolumesNegativeTest-57650260 Aug 06 14:29:44.947774 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User: tempest-VolumesNegativeTest-57650260-project Aug 06 14:29:44.947774 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Domain-Id: default Aug 06 14:29:44.947774 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Domain-Name: Default Aug 06 14:29:44.947774 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Id: 415ed747eb09431f87f85ed6be529920 Aug 06 14:29:44.947774 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Name: tempest-VolumesNegativeTest-57650260-project Aug 06 14:29:44.947774 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Aug 06 14:29:44.947774 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-355106248", "metadata": {"Type": "work"}}} Aug 06 14:29:44.947774 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: method: Aug 06 14:29:44.947774 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 06 14:29:44.948580 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-355106248', 'metadata': {'Type': 'work'}}}} Aug 06 14:29:44.948580 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 14:29:44.948580 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:29:44.948580 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 06 14:29:44.948580 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 06 14:29:44.948580 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 06 14:29:44.948580 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise error Aug 06 14:29:44.948580 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 06 14:29:44.948580 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:29:44.948580 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 06 14:29:44.948580 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 06 14:29:44.948580 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:29:44.948580 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 06 14:29:44.948580 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi '#$%' Aug 06 14:29:44.948580 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:29:44.948580 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:29:44.948580 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:29:44.948580 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:29:44.948580 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:29:44.948580 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:29:44.948580 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 14:29:44.948580 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 14:29:44.950083 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 14:29:44.950083 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 14:29:44.950083 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 14:29:44.950083 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 14:29:44.950083 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 06 14:29:44.950083 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 06 14:29:44.950083 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 06 14:29:44.950083 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 06 14:29:44.950083 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 06 14:29:44.950083 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 06 14:29:44.950083 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 06 14:29:44.950083 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:29:44.950083 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:29:44.950083 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:29:44.950083 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:29:44.950083 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:29:44.950083 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:29:44.950083 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 06 14:29:44.950083 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 06 14:29:44.951435 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 06 14:29:44.951435 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:29:44.953056 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-e5f22761-4005-49cb-9f74-a41626f9a591 tempest-VolumesNegativeTest-57650260 tempest-VolumesNegativeTest-57650260-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 14:29:44.954278 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-e5f22761-4005-49cb-9f74-a41626f9a591 tempest-VolumesNegativeTest-57650260 tempest-VolumesNegativeTest-57650260-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.865538 Aug 06 14:29:44.957462 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 1/1] 10.222.0.17 () {60 vars in 1156 bytes} [Sat Aug 6 14:29:44 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 871 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 06 14:29:44.975094 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-16f939da-92b2-4972-aa46-9a0f28257757 tempest-VolumesNegativeTest-57650260 tempest-VolumesNegativeTest-57650260-project] Action: 'create', calling method: .version_select at 0x7fbab33de550>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-606075976", "metadata": {"Type": "work"}}} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:29:44.987438 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-16f939da-92b2-4972-aa46-9a0f28257757 tempest-VolumesNegativeTest-57650260 tempest-VolumesNegativeTest-57650260-project] Request method failure captured: Aug 06 14:29:44.987438 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 06 14:29:44.987438 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Accept: application/json Aug 06 14:29:44.987438 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Accept-Encoding: identity Aug 06 14:29:44.987438 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Connection: close Aug 06 14:29:44.987438 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Content-Length: 119 Aug 06 14:29:44.987438 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Content-Type: application/json Aug 06 14:29:44.987438 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Host: 10.222.0.17 Aug 06 14:29:44.987438 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Openstack-System-Scope: None Aug 06 14:29:44.987438 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: User-Agent: python-urllib3/1.26.11 Aug 06 14:29:44.987438 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Auth-Token: gAAAAABi7nrXr5FhguppuqpLjRin7ACV2EqPNQGjMzdur-5IKMd5ATGH_bxbgGllIC0edRUX2L3UTM7sCCoNqCFe_ivVJtsU_P8xXKs6LeUbNvjZooFkyC6uxWdO4MxgcmmK4kjqFNDfDp2yvuEq5fAHQxwZCyyn8pX39bfJ0B2A8U-lCzarzPo Aug 06 14:29:44.987438 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Domain-Id: None Aug 06 14:29:44.987438 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Domain-Name: None Aug 06 14:29:44.987438 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Identity-Status: Confirmed Aug 06 14:29:44.987438 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Is-Admin-Project: True Aug 06 14:29:44.987438 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Domain-Id: default Aug 06 14:29:44.987438 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Domain-Name: Default Aug 06 14:29:44.987438 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Id: cd365cea868b4d9f8b9445569fd1e470 Aug 06 14:29:44.987438 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Name: tempest-VolumesNegativeTest-57650260 Aug 06 14:29:44.987438 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Role: member,reader Aug 06 14:29:44.987438 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Roles: member,reader Aug 06 14:29:44.988751 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cd365cea868b4d9f8b9445569fd1e470"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cd365cea868b4d9f8b9445569fd1e470"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cd365cea868b4d9f8b9445569fd1e470", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cd365cea868b4d9f8b9445569fd1e470"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 06 14:29:44.988751 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant: tempest-VolumesNegativeTest-57650260 Aug 06 14:29:44.988751 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant-Id: cd365cea868b4d9f8b9445569fd1e470 Aug 06 14:29:44.988751 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant-Name: tempest-VolumesNegativeTest-57650260 Aug 06 14:29:44.988751 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User: tempest-VolumesNegativeTest-57650260-project Aug 06 14:29:44.988751 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Domain-Id: default Aug 06 14:29:44.988751 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Domain-Name: Default Aug 06 14:29:44.988751 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Id: 415ed747eb09431f87f85ed6be529920 Aug 06 14:29:44.988751 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Name: tempest-VolumesNegativeTest-57650260-project Aug 06 14:29:44.988751 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Aug 06 14:29:44.988751 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-606075976", "metadata": {"Type": "work"}}} Aug 06 14:29:44.988751 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: method: Aug 06 14:29:44.988751 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 06 14:29:44.989598 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-606075976', 'metadata': {'Type': 'work'}}}} Aug 06 14:29:44.989598 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 14:29:44.989598 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:29:44.989598 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 06 14:29:44.989598 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 06 14:29:44.989598 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 06 14:29:44.989598 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise error Aug 06 14:29:44.989598 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 06 14:29:44.989598 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:29:44.989598 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 06 14:29:44.989598 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 06 14:29:44.989598 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:29:44.989598 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 06 14:29:44.989598 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi '0' Aug 06 14:29:44.989598 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:29:44.989598 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:29:44.989598 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:29:44.989598 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:29:44.989598 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:29:44.989598 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:29:44.989598 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 14:29:44.989598 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 14:29:44.991983 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 14:29:44.991983 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 14:29:44.991983 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 14:29:44.991983 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 14:29:44.991983 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 06 14:29:44.991983 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 06 14:29:44.991983 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 06 14:29:44.991983 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 06 14:29:44.991983 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 06 14:29:44.991983 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 06 14:29:44.991983 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 06 14:29:44.991983 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:29:44.991983 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:29:44.991983 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:29:44.991983 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:29:44.991983 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:29:44.991983 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:29:44.991983 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 06 14:29:44.991983 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 06 14:29:44.994779 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 06 14:29:44.994779 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:29:44.994779 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-16f939da-92b2-4972-aa46-9a0f28257757 tempest-VolumesNegativeTest-57650260 tempest-VolumesNegativeTest-57650260-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 14:29:44.994779 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-16f939da-92b2-4972-aa46-9a0f28257757 tempest-VolumesNegativeTest-57650260 tempest-VolumesNegativeTest-57650260-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.024168 Aug 06 14:29:44.996854 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 2/2] 10.222.0.17 () {60 vars in 1156 bytes} [Sat Aug 6 14:29:44 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 06 14:29:45.001860 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-a0306c8a-4932-406f-8881-5cb957b13f0e tempest-VolumesNegativeTest-57650260 tempest-VolumesNegativeTest-57650260-project] Action: 'create', calling method: .version_select at 0x7fbab339d9d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1571056495", "metadata": {"Type": "work"}}} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:29:45.016093 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-a0306c8a-4932-406f-8881-5cb957b13f0e tempest-VolumesNegativeTest-57650260 tempest-VolumesNegativeTest-57650260-project] Request method failure captured: Aug 06 14:29:45.016093 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 06 14:29:45.016093 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Accept: application/json Aug 06 14:29:45.016093 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Accept-Encoding: identity Aug 06 14:29:45.016093 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Connection: close Aug 06 14:29:45.016093 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Content-Length: 119 Aug 06 14:29:45.016093 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Content-Type: application/json Aug 06 14:29:45.016093 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Host: 10.222.0.17 Aug 06 14:29:45.016093 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Openstack-System-Scope: None Aug 06 14:29:45.016093 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: User-Agent: python-urllib3/1.26.11 Aug 06 14:29:45.016093 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Auth-Token: gAAAAABi7nrXr5FhguppuqpLjRin7ACV2EqPNQGjMzdur-5IKMd5ATGH_bxbgGllIC0edRUX2L3UTM7sCCoNqCFe_ivVJtsU_P8xXKs6LeUbNvjZooFkyC6uxWdO4MxgcmmK4kjqFNDfDp2yvuEq5fAHQxwZCyyn8pX39bfJ0B2A8U-lCzarzPo Aug 06 14:29:45.016093 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Domain-Id: None Aug 06 14:29:45.016093 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Domain-Name: None Aug 06 14:29:45.016093 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Identity-Status: Confirmed Aug 06 14:29:45.016093 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Is-Admin-Project: True Aug 06 14:29:45.016093 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Domain-Id: default Aug 06 14:29:45.016093 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Domain-Name: Default Aug 06 14:29:45.016093 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Id: cd365cea868b4d9f8b9445569fd1e470 Aug 06 14:29:45.016093 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Name: tempest-VolumesNegativeTest-57650260 Aug 06 14:29:45.016093 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Role: member,reader Aug 06 14:29:45.016093 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Roles: member,reader Aug 06 14:29:45.017592 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cd365cea868b4d9f8b9445569fd1e470"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cd365cea868b4d9f8b9445569fd1e470"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cd365cea868b4d9f8b9445569fd1e470", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cd365cea868b4d9f8b9445569fd1e470"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 06 14:29:45.017592 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant: tempest-VolumesNegativeTest-57650260 Aug 06 14:29:45.017592 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant-Id: cd365cea868b4d9f8b9445569fd1e470 Aug 06 14:29:45.017592 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant-Name: tempest-VolumesNegativeTest-57650260 Aug 06 14:29:45.017592 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User: tempest-VolumesNegativeTest-57650260-project Aug 06 14:29:45.017592 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Domain-Id: default Aug 06 14:29:45.017592 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Domain-Name: Default Aug 06 14:29:45.017592 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Id: 415ed747eb09431f87f85ed6be529920 Aug 06 14:29:45.017592 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Name: tempest-VolumesNegativeTest-57650260-project Aug 06 14:29:45.017592 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Aug 06 14:29:45.017592 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1571056495", "metadata": {"Type": "work"}}} Aug 06 14:29:45.017592 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: method: Aug 06 14:29:45.017592 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 06 14:29:45.018379 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1571056495', 'metadata': {'Type': 'work'}}}} Aug 06 14:29:45.018379 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 14:29:45.018379 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:29:45.018379 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 06 14:29:45.018379 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 06 14:29:45.018379 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 06 14:29:45.018379 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise error Aug 06 14:29:45.018379 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 06 14:29:45.018379 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:29:45.018379 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 06 14:29:45.018379 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 06 14:29:45.018379 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:29:45.018379 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 06 14:29:45.018379 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi '' Aug 06 14:29:45.018379 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:29:45.018379 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:29:45.018379 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:29:45.018379 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:29:45.018379 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:29:45.018379 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:29:45.018379 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 14:29:45.018379 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 14:29:45.019699 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 14:29:45.019699 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 14:29:45.019699 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 14:29:45.019699 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 14:29:45.019699 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 06 14:29:45.019699 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 06 14:29:45.019699 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 06 14:29:45.019699 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 06 14:29:45.019699 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 06 14:29:45.019699 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 06 14:29:45.019699 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 06 14:29:45.019699 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:29:45.019699 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:29:45.019699 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:29:45.019699 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:29:45.019699 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:29:45.019699 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:29:45.019699 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 06 14:29:45.019699 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 06 14:29:45.020798 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 06 14:29:45.020798 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:29:45.020798 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-a0306c8a-4932-406f-8881-5cb957b13f0e tempest-VolumesNegativeTest-57650260 tempest-VolumesNegativeTest-57650260-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 14:29:45.020798 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-a0306c8a-4932-406f-8881-5cb957b13f0e tempest-VolumesNegativeTest-57650260 tempest-VolumesNegativeTest-57650260-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.019740 Aug 06 14:29:45.020798 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 3/3] 10.222.0.17 () {60 vars in 1156 bytes} [Sat Aug 6 14:29:44 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 06 14:29:45.041378 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-b8811504-1ca1-4745-b4a5-1fef091a9473 tempest-VolumesNegativeTest-57650260 tempest-VolumesNegativeTest-57650260-project] Calling method '.version_select at 0x7fbab339d550>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:29:45.349654 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.wsgi [None req-b8811504-1ca1-4745-b4a5-1fef091a9473 tempest-VolumesNegativeTest-57650260 tempest-VolumesNegativeTest-57650260-project] HTTP exception thrown: Volume tempest-invalid-107650465 could not be found. Aug 06 14:29:45.354561 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-b8811504-1ca1-4745-b4a5-1fef091a9473 tempest-VolumesNegativeTest-57650260 tempest-VolumesNegativeTest-57650260-project] Request method failure captured: Aug 06 14:29:45.354561 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-107650465 HTTP/1.1 Aug 06 14:29:45.354561 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Accept: application/json Aug 06 14:29:45.354561 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Accept-Encoding: identity Aug 06 14:29:45.354561 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Connection: close Aug 06 14:29:45.354561 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Content-Length: 0 Aug 06 14:29:45.354561 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Content-Type: application/json Aug 06 14:29:45.354561 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Host: 10.222.0.17 Aug 06 14:29:45.354561 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Openstack-System-Scope: None Aug 06 14:29:45.354561 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: User-Agent: python-urllib3/1.26.11 Aug 06 14:29:45.354561 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Auth-Token: gAAAAABi7nrXr5FhguppuqpLjRin7ACV2EqPNQGjMzdur-5IKMd5ATGH_bxbgGllIC0edRUX2L3UTM7sCCoNqCFe_ivVJtsU_P8xXKs6LeUbNvjZooFkyC6uxWdO4MxgcmmK4kjqFNDfDp2yvuEq5fAHQxwZCyyn8pX39bfJ0B2A8U-lCzarzPo Aug 06 14:29:45.354561 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Domain-Id: None Aug 06 14:29:45.354561 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Domain-Name: None Aug 06 14:29:45.354561 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Identity-Status: Confirmed Aug 06 14:29:45.354561 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Is-Admin-Project: True Aug 06 14:29:45.354561 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Domain-Id: default Aug 06 14:29:45.354561 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Domain-Name: Default Aug 06 14:29:45.354561 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Id: cd365cea868b4d9f8b9445569fd1e470 Aug 06 14:29:45.354561 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Name: tempest-VolumesNegativeTest-57650260 Aug 06 14:29:45.354561 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Role: member,reader Aug 06 14:29:45.354561 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Roles: member,reader Aug 06 14:29:45.356042 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cd365cea868b4d9f8b9445569fd1e470"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cd365cea868b4d9f8b9445569fd1e470"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cd365cea868b4d9f8b9445569fd1e470", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cd365cea868b4d9f8b9445569fd1e470"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 06 14:29:45.356042 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant: tempest-VolumesNegativeTest-57650260 Aug 06 14:29:45.356042 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant-Id: cd365cea868b4d9f8b9445569fd1e470 Aug 06 14:29:45.356042 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant-Name: tempest-VolumesNegativeTest-57650260 Aug 06 14:29:45.356042 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User: tempest-VolumesNegativeTest-57650260-project Aug 06 14:29:45.356042 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Domain-Id: default Aug 06 14:29:45.356042 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Domain-Name: Default Aug 06 14:29:45.356042 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Id: 415ed747eb09431f87f85ed6be529920 Aug 06 14:29:45.356042 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Name: tempest-VolumesNegativeTest-57650260-project Aug 06 14:29:45.356042 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: method: Aug 06 14:29:45.356042 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: exception: Volume tempest-invalid-107650465 could not be found. Aug 06 14:29:45.356042 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: action_args: {'id': 'tempest-invalid-107650465'} Aug 06 14:29:45.356042 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 14:29:45.356827 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:29:45.356827 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 14:29:45.356827 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 14:29:45.356827 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 06 14:29:45.356827 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 06 14:29:45.356827 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 06 14:29:45.356827 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 06 14:29:45.356827 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 06 14:29:45.356827 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 06 14:29:45.356827 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 06 14:29:45.356827 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 06 14:29:45.356827 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 14:29:45.356827 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 14:29:45.356827 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 14:29:45.356827 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 14:29:45.356827 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-107650465 could not be found. (HTTP 404) (Request-ID: req-f1722a44-3752-4f40-862b-d1233f1b316e) Aug 06 14:29:45.356827 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:29:45.356827 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:29:45.356827 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:29:45.357942 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:29:45.357942 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 06 14:29:45.357942 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 06 14:29:45.357942 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 06 14:29:45.357942 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 06 14:29:45.357942 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 06 14:29:45.357942 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 06 14:29:45.357942 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 06 14:29:45.357942 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 06 14:29:45.357942 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 14:29:45.357942 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 14:29:45.357942 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 06 14:29:45.357942 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 06 14:29:45.357942 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 06 14:29:45.357942 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 06 14:29:45.357942 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 06 14:29:45.357942 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 06 14:29:45.357942 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 06 14:29:45.357942 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 06 14:29:45.360790 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 14:29:45.360790 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 14:29:45.360790 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 14:29:45.360790 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 14:29:45.360790 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-107650465 could not be found. Aug 06 14:29:45.360790 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:29:45.360790 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:29:45.360790 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:29:45.360790 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:29:45.360790 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:29:45.360790 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:29:45.360790 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 14:29:45.360790 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 14:29:45.360790 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 14:29:45.360790 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 14:29:45.360790 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 14:29:45.360790 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 14:29:45.360790 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 06 14:29:45.360790 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 14:29:45.360790 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-107650465 could not be found. Aug 06 14:29:45.364221 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:29:45.364221 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:29:45.364221 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:29:45.364221 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:29:45.364221 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:29:45.364221 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:29:45.364221 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 14:29:45.364221 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 14:29:45.364221 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-107650465 could not be found. Aug 06 14:29:45.364221 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:29:45.364221 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-b8811504-1ca1-4745-b4a5-1fef091a9473 tempest-VolumesNegativeTest-57650260 tempest-VolumesNegativeTest-57650260-project] Returning 404 to user: Volume tempest-invalid-107650465 could not be found. {{(pid=117837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 14:29:45.364221 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-b8811504-1ca1-4745-b4a5-1fef091a9473 tempest-VolumesNegativeTest-57650260 tempest-VolumesNegativeTest-57650260-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/tempest-invalid-107650465" status: 404 len: 98 microversion: 2.1 time: 0.321102 Aug 06 14:29:45.364221 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 4/4] 10.222.0.17 () {58 vars in 1215 bytes} [Sat Aug 6 14:29:45 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-107650465 => generated 98 bytes in 326 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 06 14:29:45.374368 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-14b24c1f-e483-4656-9750-cf9dfa266ef3 tempest-VolumesNegativeTest-57650260 tempest-VolumesNegativeTest-57650260-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004722 Aug 06 14:29:45.374965 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 5/5] 10.222.0.17 () {58 vars in 1140 bytes} [Sat Aug 6 14:29:45 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 06 14:29:45.389395 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-473eb12b-548a-44ee-9618-cab40116c5db tempest-VolumesNegativeTest-57650260 tempest-VolumesNegativeTest-57650260-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006112 Aug 06 14:29:45.395145 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 6/6] 10.222.0.17 () {58 vars in 1137 bytes} [Sat Aug 6 14:29:45 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 06 14:29:45.403325 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-ddf7c0c4-a0d5-4500-bbf0-04c492f2fcfb tempest-VolumesNegativeTest-57650260 tempest-VolumesNegativeTest-57650260-project] Calling method '.version_select at 0x7fbab32d7d30>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:29:45.445824 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.wsgi [None req-ddf7c0c4-a0d5-4500-bbf0-04c492f2fcfb tempest-VolumesNegativeTest-57650260 tempest-VolumesNegativeTest-57650260-project] HTTP exception thrown: Volume 587d277d-a307-4133-b2ce-f9c9a0db560e could not be found. Aug 06 14:29:45.448396 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-ddf7c0c4-a0d5-4500-bbf0-04c492f2fcfb tempest-VolumesNegativeTest-57650260 tempest-VolumesNegativeTest-57650260-project] Request method failure captured: Aug 06 14:29:45.448396 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: request: DELETE /compute/v2.1/os-volumes/587d277d-a307-4133-b2ce-f9c9a0db560e HTTP/1.1 Aug 06 14:29:45.448396 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Accept: application/json Aug 06 14:29:45.448396 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Accept-Encoding: identity Aug 06 14:29:45.448396 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Connection: close Aug 06 14:29:45.448396 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Content-Length: 0 Aug 06 14:29:45.448396 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Content-Type: application/json Aug 06 14:29:45.448396 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Host: 10.222.0.17 Aug 06 14:29:45.448396 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Openstack-System-Scope: None Aug 06 14:29:45.448396 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: User-Agent: python-urllib3/1.26.11 Aug 06 14:29:45.448396 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Auth-Token: gAAAAABi7nrXr5FhguppuqpLjRin7ACV2EqPNQGjMzdur-5IKMd5ATGH_bxbgGllIC0edRUX2L3UTM7sCCoNqCFe_ivVJtsU_P8xXKs6LeUbNvjZooFkyC6uxWdO4MxgcmmK4kjqFNDfDp2yvuEq5fAHQxwZCyyn8pX39bfJ0B2A8U-lCzarzPo Aug 06 14:29:45.448396 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Domain-Id: None Aug 06 14:29:45.448396 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Domain-Name: None Aug 06 14:29:45.448396 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Identity-Status: Confirmed Aug 06 14:29:45.448396 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Is-Admin-Project: True Aug 06 14:29:45.448396 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Domain-Id: default Aug 06 14:29:45.448396 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Domain-Name: Default Aug 06 14:29:45.448396 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Id: cd365cea868b4d9f8b9445569fd1e470 Aug 06 14:29:45.448396 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Name: tempest-VolumesNegativeTest-57650260 Aug 06 14:29:45.448396 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Role: member,reader Aug 06 14:29:45.448396 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Roles: member,reader Aug 06 14:29:45.449621 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cd365cea868b4d9f8b9445569fd1e470"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cd365cea868b4d9f8b9445569fd1e470"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cd365cea868b4d9f8b9445569fd1e470", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cd365cea868b4d9f8b9445569fd1e470"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 06 14:29:45.449621 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant: tempest-VolumesNegativeTest-57650260 Aug 06 14:29:45.449621 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant-Id: cd365cea868b4d9f8b9445569fd1e470 Aug 06 14:29:45.449621 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant-Name: tempest-VolumesNegativeTest-57650260 Aug 06 14:29:45.449621 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User: tempest-VolumesNegativeTest-57650260-project Aug 06 14:29:45.449621 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Domain-Id: default Aug 06 14:29:45.449621 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Domain-Name: Default Aug 06 14:29:45.449621 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Id: 415ed747eb09431f87f85ed6be529920 Aug 06 14:29:45.449621 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Name: tempest-VolumesNegativeTest-57650260-project Aug 06 14:29:45.449621 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: method: Aug 06 14:29:45.449621 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: exception: Volume 587d277d-a307-4133-b2ce-f9c9a0db560e could not be found. Aug 06 14:29:45.449621 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: action_args: {'id': '587d277d-a307-4133-b2ce-f9c9a0db560e'} Aug 06 14:29:45.449621 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 14:29:45.450362 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:29:45.450362 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 14:29:45.450362 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 14:29:45.450362 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 06 14:29:45.450362 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 06 14:29:45.450362 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 06 14:29:45.450362 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 06 14:29:45.450362 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 06 14:29:45.450362 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 06 14:29:45.450362 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 06 14:29:45.450362 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 06 14:29:45.450362 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 14:29:45.450362 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 14:29:45.450362 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 14:29:45.450362 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 14:29:45.450362 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 587d277d-a307-4133-b2ce-f9c9a0db560e could not be found. (HTTP 404) (Request-ID: req-6b532789-6538-414b-af5c-6c11070b7ab5) Aug 06 14:29:45.450362 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:29:45.450362 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:29:45.450362 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:29:45.451525 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:29:45.451525 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 06 14:29:45.451525 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 06 14:29:45.451525 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 06 14:29:45.451525 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 06 14:29:45.451525 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 06 14:29:45.451525 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 06 14:29:45.451525 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 06 14:29:45.451525 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 06 14:29:45.451525 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 14:29:45.451525 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 14:29:45.451525 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 06 14:29:45.451525 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 06 14:29:45.451525 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 06 14:29:45.451525 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 06 14:29:45.451525 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 06 14:29:45.451525 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 06 14:29:45.451525 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 06 14:29:45.451525 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 06 14:29:45.452600 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 14:29:45.452600 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 14:29:45.452600 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 14:29:45.452600 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 14:29:45.452600 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 587d277d-a307-4133-b2ce-f9c9a0db560e could not be found. Aug 06 14:29:45.452600 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:29:45.452600 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:29:45.452600 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:29:45.452600 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:29:45.452600 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:29:45.452600 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:29:45.452600 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 14:29:45.452600 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 14:29:45.452600 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 14:29:45.452600 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 14:29:45.452600 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 14:29:45.452600 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 14:29:45.452600 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 06 14:29:45.452600 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 14:29:45.453655 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 587d277d-a307-4133-b2ce-f9c9a0db560e could not be found. Aug 06 14:29:45.453655 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:29:45.453655 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:29:45.453655 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:29:45.453655 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:29:45.453655 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:29:45.453655 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:29:45.453655 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 14:29:45.453655 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 14:29:45.453655 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 587d277d-a307-4133-b2ce-f9c9a0db560e could not be found. Aug 06 14:29:45.453655 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:29:45.453655 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-ddf7c0c4-a0d5-4500-bbf0-04c492f2fcfb tempest-VolumesNegativeTest-57650260 tempest-VolumesNegativeTest-57650260-project] Returning 404 to user: Volume 587d277d-a307-4133-b2ce-f9c9a0db560e could not be found. {{(pid=117837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 14:29:45.453655 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-ddf7c0c4-a0d5-4500-bbf0-04c492f2fcfb tempest-VolumesNegativeTest-57650260 tempest-VolumesNegativeTest-57650260-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/587d277d-a307-4133-b2ce-f9c9a0db560e" status: 404 len: 109 microversion: 2.1 time: 0.053554 Aug 06 14:29:45.457291 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 7/7] 10.222.0.17 () {58 vars in 1248 bytes} [Sat Aug 6 14:29:45 2022] DELETE /compute/v2.1/os-volumes/587d277d-a307-4133-b2ce-f9c9a0db560e => generated 109 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 06 14:29:45.464556 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-349539ec-ac5d-425d-ac67-62d7b32cfcf2 tempest-VolumesNegativeTest-57650260 tempest-VolumesNegativeTest-57650260-project] Calling method '.version_select at 0x7fbab32d7670>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:29:45.514775 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.wsgi [None req-349539ec-ac5d-425d-ac67-62d7b32cfcf2 tempest-VolumesNegativeTest-57650260 tempest-VolumesNegativeTest-57650260-project] HTTP exception thrown: Volume b35bce3a-d94e-4dce-9d65-f5da70335d13 could not be found. Aug 06 14:29:45.518107 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-349539ec-ac5d-425d-ac67-62d7b32cfcf2 tempest-VolumesNegativeTest-57650260 tempest-VolumesNegativeTest-57650260-project] Request method failure captured: Aug 06 14:29:45.518107 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: request: GET /compute/v2.1/os-volumes/b35bce3a-d94e-4dce-9d65-f5da70335d13 HTTP/1.1 Aug 06 14:29:45.518107 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Accept: application/json Aug 06 14:29:45.518107 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Accept-Encoding: identity Aug 06 14:29:45.518107 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Connection: close Aug 06 14:29:45.518107 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Content-Length: 0 Aug 06 14:29:45.518107 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Content-Type: application/json Aug 06 14:29:45.518107 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Host: 10.222.0.17 Aug 06 14:29:45.518107 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Openstack-System-Scope: None Aug 06 14:29:45.518107 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: User-Agent: python-urllib3/1.26.11 Aug 06 14:29:45.518107 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Auth-Token: gAAAAABi7nrXr5FhguppuqpLjRin7ACV2EqPNQGjMzdur-5IKMd5ATGH_bxbgGllIC0edRUX2L3UTM7sCCoNqCFe_ivVJtsU_P8xXKs6LeUbNvjZooFkyC6uxWdO4MxgcmmK4kjqFNDfDp2yvuEq5fAHQxwZCyyn8pX39bfJ0B2A8U-lCzarzPo Aug 06 14:29:45.518107 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Domain-Id: None Aug 06 14:29:45.518107 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Domain-Name: None Aug 06 14:29:45.518107 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Identity-Status: Confirmed Aug 06 14:29:45.518107 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Is-Admin-Project: True Aug 06 14:29:45.518107 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Domain-Id: default Aug 06 14:29:45.518107 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Domain-Name: Default Aug 06 14:29:45.518107 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Id: cd365cea868b4d9f8b9445569fd1e470 Aug 06 14:29:45.518107 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Name: tempest-VolumesNegativeTest-57650260 Aug 06 14:29:45.518107 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Role: member,reader Aug 06 14:29:45.518107 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Roles: member,reader Aug 06 14:29:45.519591 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cd365cea868b4d9f8b9445569fd1e470"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cd365cea868b4d9f8b9445569fd1e470"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cd365cea868b4d9f8b9445569fd1e470", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cd365cea868b4d9f8b9445569fd1e470"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 06 14:29:45.519591 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant: tempest-VolumesNegativeTest-57650260 Aug 06 14:29:45.519591 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant-Id: cd365cea868b4d9f8b9445569fd1e470 Aug 06 14:29:45.519591 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant-Name: tempest-VolumesNegativeTest-57650260 Aug 06 14:29:45.519591 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User: tempest-VolumesNegativeTest-57650260-project Aug 06 14:29:45.519591 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Domain-Id: default Aug 06 14:29:45.519591 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Domain-Name: Default Aug 06 14:29:45.519591 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Id: 415ed747eb09431f87f85ed6be529920 Aug 06 14:29:45.519591 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Name: tempest-VolumesNegativeTest-57650260-project Aug 06 14:29:45.519591 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: method: Aug 06 14:29:45.519591 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: exception: Volume b35bce3a-d94e-4dce-9d65-f5da70335d13 could not be found. Aug 06 14:29:45.519591 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: action_args: {'id': 'b35bce3a-d94e-4dce-9d65-f5da70335d13'} Aug 06 14:29:45.519591 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 14:29:45.520389 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:29:45.520389 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 14:29:45.520389 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 14:29:45.520389 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 06 14:29:45.520389 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 06 14:29:45.520389 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 06 14:29:45.520389 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 06 14:29:45.520389 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 06 14:29:45.520389 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 06 14:29:45.520389 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 06 14:29:45.520389 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 06 14:29:45.520389 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 14:29:45.520389 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 14:29:45.520389 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 14:29:45.520389 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 14:29:45.520389 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b35bce3a-d94e-4dce-9d65-f5da70335d13 could not be found. (HTTP 404) (Request-ID: req-dcba279b-09f3-4cd6-8266-11626cea136a) Aug 06 14:29:45.520389 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:29:45.520389 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:29:45.520389 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:29:45.521721 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:29:45.521721 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 06 14:29:45.521721 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 06 14:29:45.521721 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 06 14:29:45.521721 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 06 14:29:45.521721 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 06 14:29:45.521721 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 06 14:29:45.521721 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 06 14:29:45.521721 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 06 14:29:45.521721 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 14:29:45.521721 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 14:29:45.521721 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 06 14:29:45.521721 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 06 14:29:45.521721 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 06 14:29:45.521721 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 06 14:29:45.521721 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 06 14:29:45.521721 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 06 14:29:45.521721 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 06 14:29:45.521721 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 06 14:29:45.522780 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 14:29:45.522780 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 14:29:45.522780 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 14:29:45.522780 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 14:29:45.522780 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b35bce3a-d94e-4dce-9d65-f5da70335d13 could not be found. Aug 06 14:29:45.522780 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:29:45.522780 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:29:45.522780 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:29:45.522780 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:29:45.522780 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:29:45.522780 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:29:45.522780 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 14:29:45.522780 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 14:29:45.522780 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 14:29:45.522780 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 14:29:45.522780 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 14:29:45.522780 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 14:29:45.522780 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 06 14:29:45.522780 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 14:29:45.523957 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b35bce3a-d94e-4dce-9d65-f5da70335d13 could not be found. Aug 06 14:29:45.523957 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:29:45.523957 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:29:45.523957 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:29:45.523957 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:29:45.523957 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:29:45.523957 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:29:45.523957 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 14:29:45.523957 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 14:29:45.523957 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b35bce3a-d94e-4dce-9d65-f5da70335d13 could not be found. Aug 06 14:29:45.523957 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:29:45.526907 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-349539ec-ac5d-425d-ac67-62d7b32cfcf2 tempest-VolumesNegativeTest-57650260 tempest-VolumesNegativeTest-57650260-project] Returning 404 to user: Volume b35bce3a-d94e-4dce-9d65-f5da70335d13 could not be found. {{(pid=117837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 14:29:45.528492 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-349539ec-ac5d-425d-ac67-62d7b32cfcf2 tempest-VolumesNegativeTest-57650260 tempest-VolumesNegativeTest-57650260-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/b35bce3a-d94e-4dce-9d65-f5da70335d13" status: 404 len: 109 microversion: 2.1 time: 0.069800 Aug 06 14:29:45.528954 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 8/8] 10.222.0.17 () {58 vars in 1245 bytes} [Sat Aug 6 14:29:45 2022] GET /compute/v2.1/os-volumes/b35bce3a-d94e-4dce-9d65-f5da70335d13 => generated 109 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 14:29:46.261437 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-d46cde18-a790-444f-916a-6fd2241332fb tempest-VolumesSnapshotsTestJSON-535569422 tempest-VolumesSnapshotsTestJSON-535569422-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.189667 Aug 06 14:29:46.262565 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 1/9] 10.222.0.17 () {60 vars in 1155 bytes} [Sat Aug 6 14:29:43 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3192 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 06 14:29:46.277732 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-cbdbacc0-99bc-42d9-b9ca-b8ce42b62801 tempest-VolumesSnapshotsTestJSON-535569422 tempest-VolumesSnapshotsTestJSON-535569422-project] Calling method '.version_select at 0x7fbab33bd700>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:29:46.433363 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-cbdbacc0-99bc-42d9-b9ca-b8ce42b62801 tempest-VolumesSnapshotsTestJSON-535569422 tempest-VolumesSnapshotsTestJSON-535569422-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/25c50b40-24bc-4991-8f14-4ad5e39ae175" status: 200 len: 345 microversion: 2.1 time: 0.160979 Aug 06 14:29:46.441173 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 9/10] 10.222.0.17 () {58 vars in 1245 bytes} [Sat Aug 6 14:29:46 2022] GET /compute/v2.1/os-volumes/25c50b40-24bc-4991-8f14-4ad5e39ae175 => generated 345 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:29:47.454432 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-d86a974a-77a9-4123-ad07-ad77f74c6fc4 tempest-VolumesSnapshotsTestJSON-535569422 tempest-VolumesSnapshotsTestJSON-535569422-project] Calling method '.version_select at 0x7fbab334dc10>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:29:47.548170 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-d86a974a-77a9-4123-ad07-ad77f74c6fc4 tempest-VolumesSnapshotsTestJSON-535569422 tempest-VolumesSnapshotsTestJSON-535569422-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/25c50b40-24bc-4991-8f14-4ad5e39ae175" status: 200 len: 345 microversion: 2.1 time: 0.098053 Aug 06 14:29:47.548915 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 2/11] 10.222.0.17 () {58 vars in 1245 bytes} [Sat Aug 6 14:29:47 2022] GET /compute/v2.1/os-volumes/25c50b40-24bc-4991-8f14-4ad5e39ae175 => generated 345 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:29:48.624866 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-78136279-eedf-4c14-bbb9-eca72247f423 tempest-VolumesSnapshotsTestJSON-535569422 tempest-VolumesSnapshotsTestJSON-535569422-project] Calling method '.version_select at 0x7fbab32d7280>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:29:48.761709 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-78136279-eedf-4c14-bbb9-eca72247f423 tempest-VolumesSnapshotsTestJSON-535569422 tempest-VolumesSnapshotsTestJSON-535569422-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/25c50b40-24bc-4991-8f14-4ad5e39ae175" status: 200 len: 346 microversion: 2.1 time: 0.202271 Aug 06 14:29:48.762784 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 10/12] 10.222.0.17 () {58 vars in 1245 bytes} [Sat Aug 6 14:29:48 2022] GET /compute/v2.1/os-volumes/25c50b40-24bc-4991-8f14-4ad5e39ae175 => generated 346 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:29:48.777948 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-b13e8e12-80cf-465f-bc3d-844e316e756d tempest-VolumesSnapshotsTestJSON-535569422 tempest-VolumesSnapshotsTestJSON-535569422-project] Action: 'create', calling method: .version_select at 0x7fbab3365280>, body: {"snapshot": {"volume_id": "25c50b40-24bc-4991-8f14-4ad5e39ae175", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1173380580"}} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:29:49.407647 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-b13e8e12-80cf-465f-bc3d-844e316e756d tempest-VolumesSnapshotsTestJSON-535569422 tempest-VolumesSnapshotsTestJSON-535569422-project] 10.222.0.17 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.635560 Aug 06 14:29:49.414519 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 3/13] 10.222.0.17 () {60 vars in 1162 bytes} [Sat Aug 6 14:29:48 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:29:49.420585 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-edc52f44-2b8a-4c2b-840f-0711d0e1a377 tempest-VolumesSnapshotsTestJSON-535569422 tempest-VolumesSnapshotsTestJSON-535569422-project] Calling method '.version_select at 0x7fbab32f6310>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:29:49.575253 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-edc52f44-2b8a-4c2b-840f-0711d0e1a377 tempest-VolumesSnapshotsTestJSON-535569422 tempest-VolumesSnapshotsTestJSON-535569422-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/dc864d8b-14e3-455e-9597-3e31b0678dfb" status: 200 len: 287 microversion: 2.1 time: 0.158834 Aug 06 14:29:49.575992 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 11/14] 10.222.0.17 () {58 vars in 1251 bytes} [Sat Aug 6 14:29:49 2022] GET /compute/v2.1/os-snapshots/dc864d8b-14e3-455e-9597-3e31b0678dfb => generated 287 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:29:49.590689 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-dc9b516f-75a2-431a-b2b4-b6ead9fffaa3 tempest-VolumesSnapshotsTestJSON-535569422 tempest-VolumesSnapshotsTestJSON-535569422-project] Calling method '.version_select at 0x7fbab3363430>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:29:49.724503 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-dc9b516f-75a2-431a-b2b4-b6ead9fffaa3 tempest-VolumesSnapshotsTestJSON-535569422 tempest-VolumesSnapshotsTestJSON-535569422-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.139927 Aug 06 14:29:49.734773 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 4/15] 10.222.0.17 () {58 vars in 1140 bytes} [Sat Aug 6 14:29:49 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:29:49.737535 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-bc56efc8-68fe-457f-ac6c-ef22fd09ee7d tempest-VolumesSnapshotsTestJSON-535569422 tempest-VolumesSnapshotsTestJSON-535569422-project] Calling method '.version_select at 0x7fbab32f6a60>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:29:49.810432 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-bc56efc8-68fe-457f-ac6c-ef22fd09ee7d tempest-VolumesSnapshotsTestJSON-535569422 tempest-VolumesSnapshotsTestJSON-535569422-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/dc864d8b-14e3-455e-9597-3e31b0678dfb" status: 200 len: 287 microversion: 2.1 time: 0.076627 Aug 06 14:29:49.811276 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 12/16] 10.222.0.17 () {58 vars in 1251 bytes} [Sat Aug 6 14:29:49 2022] GET /compute/v2.1/os-snapshots/dc864d8b-14e3-455e-9597-3e31b0678dfb => generated 287 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:29:50.823104 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-c87a7c0c-a712-488d-8b49-e6adc6117ddb tempest-VolumesSnapshotsTestJSON-535569422 tempest-VolumesSnapshotsTestJSON-535569422-project] Calling method '.version_select at 0x7fbab32d7ee0>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:29:50.896010 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-c87a7c0c-a712-488d-8b49-e6adc6117ddb tempest-VolumesSnapshotsTestJSON-535569422 tempest-VolumesSnapshotsTestJSON-535569422-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/dc864d8b-14e3-455e-9597-3e31b0678dfb" status: 200 len: 287 microversion: 2.1 time: 0.076790 Aug 06 14:29:50.896570 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 13/17] 10.222.0.17 () {58 vars in 1251 bytes} [Sat Aug 6 14:29:50 2022] GET /compute/v2.1/os-snapshots/dc864d8b-14e3-455e-9597-3e31b0678dfb => generated 287 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 14:29:51.002665 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-58b3a662-b383-4672-8581-3ea397cec45d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1368825288", "imageRef": "13d7ee60-c9c3-43ee-9861-a9192a114a77", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:29:51.230554 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.network.neutron [None req-58b3a662-b383-4672-8581-3ea397cec45d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] validate_networks() for [('d218904d-31f8-43c0-928a-70585b79ffc2', None, None, None, None, None)] {{(pid=117838) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 14:29:51.909015 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-13572310-ff61-49ef-9e50-75c4d621a3c0 tempest-VolumesSnapshotsTestJSON-535569422 tempest-VolumesSnapshotsTestJSON-535569422-project] Calling method '.version_select at 0x7fbab32d7a60>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:29:52.006319 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-13572310-ff61-49ef-9e50-75c4d621a3c0 tempest-VolumesSnapshotsTestJSON-535569422 tempest-VolumesSnapshotsTestJSON-535569422-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/dc864d8b-14e3-455e-9597-3e31b0678dfb" status: 200 len: 287 microversion: 2.1 time: 0.102301 Aug 06 14:29:52.007227 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 14/18] 10.222.0.17 () {58 vars in 1251 bytes} [Sat Aug 6 14:29:51 2022] GET /compute/v2.1/os-snapshots/dc864d8b-14e3-455e-9597-3e31b0678dfb => generated 287 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 14:29:53.022673 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-7713a35d-96ee-4502-aa6e-069eb3b9f8ad tempest-VolumesSnapshotsTestJSON-535569422 tempest-VolumesSnapshotsTestJSON-535569422-project] Calling method '.version_select at 0x7fbab32f6ca0>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:29:53.080445 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-7713a35d-96ee-4502-aa6e-069eb3b9f8ad tempest-VolumesSnapshotsTestJSON-535569422 tempest-VolumesSnapshotsTestJSON-535569422-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/dc864d8b-14e3-455e-9597-3e31b0678dfb" status: 200 len: 287 microversion: 2.1 time: 0.063280 Aug 06 14:29:53.087221 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 15/19] 10.222.0.17 () {58 vars in 1251 bytes} [Sat Aug 6 14:29:53 2022] GET /compute/v2.1/os-snapshots/dc864d8b-14e3-455e-9597-3e31b0678dfb => generated 287 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:29:54.088673 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.virt.hardware [None req-58b3a662-b383-4672-8581-3ea397cec45d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Flavor limits 0:0:0 {{(pid=117838) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 14:29:54.089179 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.virt.hardware [None req-58b3a662-b383-4672-8581-3ea397cec45d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Image limits 0:0:0 {{(pid=117838) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 14:29:54.089707 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.virt.hardware [None req-58b3a662-b383-4672-8581-3ea397cec45d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Flavor pref 0:0:0 {{(pid=117838) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 14:29:54.090068 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.virt.hardware [None req-58b3a662-b383-4672-8581-3ea397cec45d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Image pref 0:0:0 {{(pid=117838) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 14:29:54.090656 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.virt.hardware [None req-58b3a662-b383-4672-8581-3ea397cec45d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117838) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 14:29:54.099853 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-c2c6f96d-e3e5-4f00-bd4c-d256ff959123 tempest-VolumesSnapshotsTestJSON-535569422 tempest-VolumesSnapshotsTestJSON-535569422-project] Calling method '.version_select at 0x7fbab32f64c0>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:29:54.137359 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-58b3a662-b383-4672-8581-3ea397cec45d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:29:54.143774 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-58b3a662-b383-4672-8581-3ea397cec45d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:29:54.145380 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-58b3a662-b383-4672-8581-3ea397cec45d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:29:54.154466 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-58b3a662-b383-4672-8581-3ea397cec45d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:29:54.156229 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-58b3a662-b383-4672-8581-3ea397cec45d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:29:54.157509 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-58b3a662-b383-4672-8581-3ea397cec45d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:29:54.180103 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-c2c6f96d-e3e5-4f00-bd4c-d256ff959123 tempest-VolumesSnapshotsTestJSON-535569422 tempest-VolumesSnapshotsTestJSON-535569422-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/dc864d8b-14e3-455e-9597-3e31b0678dfb" status: 200 len: 287 microversion: 2.1 time: 0.089816 Aug 06 14:29:54.180967 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 16/20] 10.222.0.17 () {58 vars in 1251 bytes} [Sat Aug 6 14:29:54 2022] GET /compute/v2.1/os-snapshots/dc864d8b-14e3-455e-9597-3e31b0678dfb => generated 287 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:29:54.225115 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.quota [None req-58b3a662-b383-4672-8581-3ea397cec45d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Getting quotas for project d19dc46cdcf549b0a6383c8b99d6f15f. Resources: {'cores', 'instances', 'ram'} {{(pid=117838) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 14:29:54.237191 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.quota [None req-58b3a662-b383-4672-8581-3ea397cec45d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Getting quotas for user 4dadf737392d4153ae50de020534f070 and project d19dc46cdcf549b0a6383c8b99d6f15f. Resources: {'cores', 'instances', 'ram'} {{(pid=117838) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 14:29:54.263359 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-58b3a662-b383-4672-8581-3ea397cec45d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Going to run 1 instances... {{(pid=117838) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 14:29:54.268394 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-58b3a662-b383-4672-8581-3ea397cec45d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: d1cbde5c-7d9e-49cc-ba65-31507c04c60b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='13d7ee60-c9c3-43ee-9861-a9192a114a77',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117838) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 14:29:54.452247 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-58b3a662-b383-4672-8581-3ea397cec45d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.874659 Aug 06 14:29:54.453543 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 5/21] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Aug 6 14:29:50 2022] POST /compute/v2.1/servers => generated 383 bytes in 3877 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 14:29:54.465303 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-a0af19a0-be4b-4659-8254-10b004db4f15 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:29:54.466265 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-a0af19a0-be4b-4659-8254-10b004db4f15 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: d1cbde5c-7d9e-49cc-ba65-31507c04c60b] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:29:54.652312 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-a0af19a0-be4b-4659-8254-10b004db4f15 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:29:54.679053 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-a0af19a0-be4b-4659-8254-10b004db4f15 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b" status: 200 len: 1222 microversion: 2.1 time: 0.209839 Aug 06 14:29:54.691464 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 17/22] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:29:54 2022] GET /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b => generated 1222 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:29:54.901561 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-7bc20102-c500-4bc1-92b5-0b8816f61f3c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1079755474", "imageRef": "13d7ee60-c9c3-43ee-9861-a9192a114a77", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:29:54.992334 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.network.neutron [None req-7bc20102-c500-4bc1-92b5-0b8816f61f3c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] validate_networks() for [('d218904d-31f8-43c0-928a-70585b79ffc2', None, None, None, None, None)] {{(pid=117838) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 14:29:55.195024 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-fda87be4-47d8-492d-825c-3415c6dd95cd tempest-VolumesSnapshotsTestJSON-535569422 tempest-VolumesSnapshotsTestJSON-535569422-project] Calling method '.version_select at 0x7fbab32d71f0>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:29:55.261159 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-fda87be4-47d8-492d-825c-3415c6dd95cd tempest-VolumesSnapshotsTestJSON-535569422 tempest-VolumesSnapshotsTestJSON-535569422-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/dc864d8b-14e3-455e-9597-3e31b0678dfb" status: 200 len: 287 microversion: 2.1 time: 0.069980 Aug 06 14:29:55.261815 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 18/23] 10.222.0.17 () {58 vars in 1251 bytes} [Sat Aug 6 14:29:55 2022] GET /compute/v2.1/os-snapshots/dc864d8b-14e3-455e-9597-3e31b0678dfb => generated 287 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:29:56.281887 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-c396d9b1-ddcb-41ac-8ea1-c3cecaff4d50 tempest-VolumesSnapshotsTestJSON-535569422 tempest-VolumesSnapshotsTestJSON-535569422-project] Calling method '.version_select at 0x7fbab32a7c10>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:29:56.412227 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-c396d9b1-ddcb-41ac-8ea1-c3cecaff4d50 tempest-VolumesSnapshotsTestJSON-535569422 tempest-VolumesSnapshotsTestJSON-535569422-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/dc864d8b-14e3-455e-9597-3e31b0678dfb" status: 200 len: 288 microversion: 2.1 time: 0.134960 Aug 06 14:29:56.413267 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 19/24] 10.222.0.17 () {58 vars in 1251 bytes} [Sat Aug 6 14:29:56 2022] GET /compute/v2.1/os-snapshots/dc864d8b-14e3-455e-9597-3e31b0678dfb => generated 288 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:29:56.437065 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-8ffc1e99-8b92-4114-a98b-bb28a62aad71 tempest-VolumesSnapshotsTestJSON-535569422 tempest-VolumesSnapshotsTestJSON-535569422-project] Calling method '.version_select at 0x7fbab32b1040>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:29:56.600812 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-8ffc1e99-8b92-4114-a98b-bb28a62aad71 tempest-VolumesSnapshotsTestJSON-535569422 tempest-VolumesSnapshotsTestJSON-535569422-project] 10.222.0.17 "DELETE /compute/v2.1/os-snapshots/dc864d8b-14e3-455e-9597-3e31b0678dfb" status: 202 len: 0 microversion: 2.1 time: 0.180328 Aug 06 14:29:56.602598 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 20/25] 10.222.0.17 () {58 vars in 1254 bytes} [Sat Aug 6 14:29:56 2022] DELETE /compute/v2.1/os-snapshots/dc864d8b-14e3-455e-9597-3e31b0678dfb => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 14:29:56.611547 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-6452038b-b834-4738-9f7a-d2ba11663c83 tempest-VolumesSnapshotsTestJSON-535569422 tempest-VolumesSnapshotsTestJSON-535569422-project] Calling method '.version_select at 0x7fbab32b1700>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:29:56.687410 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-6452038b-b834-4738-9f7a-d2ba11663c83 tempest-VolumesSnapshotsTestJSON-535569422 tempest-VolumesSnapshotsTestJSON-535569422-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/dc864d8b-14e3-455e-9597-3e31b0678dfb" status: 200 len: 287 microversion: 2.1 time: 0.080319 Aug 06 14:29:56.691135 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 21/26] 10.222.0.17 () {58 vars in 1251 bytes} [Sat Aug 6 14:29:56 2022] GET /compute/v2.1/os-snapshots/dc864d8b-14e3-455e-9597-3e31b0678dfb => generated 287 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:29:57.700470 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-aee6190f-6cac-4fce-b3cf-d83d4498c187 tempest-VolumesSnapshotsTestJSON-535569422 tempest-VolumesSnapshotsTestJSON-535569422-project] Calling method '.version_select at 0x7fbab32a7ca0>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:29:57.766242 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.wsgi [None req-aee6190f-6cac-4fce-b3cf-d83d4498c187 tempest-VolumesSnapshotsTestJSON-535569422 tempest-VolumesSnapshotsTestJSON-535569422-project] HTTP exception thrown: Snapshot dc864d8b-14e3-455e-9597-3e31b0678dfb could not be found. Aug 06 14:29:57.768735 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-aee6190f-6cac-4fce-b3cf-d83d4498c187 tempest-VolumesSnapshotsTestJSON-535569422 tempest-VolumesSnapshotsTestJSON-535569422-project] Request method failure captured: Aug 06 14:29:57.768735 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: request: GET /compute/v2.1/os-snapshots/dc864d8b-14e3-455e-9597-3e31b0678dfb HTTP/1.1 Aug 06 14:29:57.768735 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Accept: application/json Aug 06 14:29:57.768735 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Accept-Encoding: identity Aug 06 14:29:57.768735 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Connection: close Aug 06 14:29:57.768735 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Content-Length: 0 Aug 06 14:29:57.768735 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Content-Type: application/json Aug 06 14:29:57.768735 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Host: 10.222.0.17 Aug 06 14:29:57.768735 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Openstack-System-Scope: None Aug 06 14:29:57.768735 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: User-Agent: python-urllib3/1.26.11 Aug 06 14:29:57.768735 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Auth-Token: gAAAAABi7nrWwc4-zmLgDAVK4U05Gv1SyEtWXENIJfqST8aB_2BNz5ccfe-8exgTvzZn5wIVrLq2ltkmXpCSnMXKaY8XvEJoVRzIlEhGNEIW27uwQAbEhZb84HNbNhoG-WuST5lMnR6t3UGYmUUKx3HdrlJyCt90H0RhblrdRGu568P7eHXeoJ8 Aug 06 14:29:57.768735 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Domain-Id: None Aug 06 14:29:57.768735 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Domain-Name: None Aug 06 14:29:57.768735 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Identity-Status: Confirmed Aug 06 14:29:57.768735 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Is-Admin-Project: True Aug 06 14:29:57.768735 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Domain-Id: default Aug 06 14:29:57.768735 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Domain-Name: Default Aug 06 14:29:57.768735 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Id: 4ec92e2a9a9e47519d4003039ea1a0bc Aug 06 14:29:57.768735 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-535569422 Aug 06 14:29:57.768735 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Role: member,reader Aug 06 14:29:57.768735 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Roles: member,reader Aug 06 14:29:57.770108 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4ec92e2a9a9e47519d4003039ea1a0bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4ec92e2a9a9e47519d4003039ea1a0bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4ec92e2a9a9e47519d4003039ea1a0bc", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4ec92e2a9a9e47519d4003039ea1a0bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 06 14:29:57.770108 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant: tempest-VolumesSnapshotsTestJSON-535569422 Aug 06 14:29:57.770108 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant-Id: 4ec92e2a9a9e47519d4003039ea1a0bc Aug 06 14:29:57.770108 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-535569422 Aug 06 14:29:57.770108 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User: tempest-VolumesSnapshotsTestJSON-535569422-project Aug 06 14:29:57.770108 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Domain-Id: default Aug 06 14:29:57.770108 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Domain-Name: Default Aug 06 14:29:57.770108 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Id: a6275ec0936a4471a49b9a6aa1eef931 Aug 06 14:29:57.770108 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Name: tempest-VolumesSnapshotsTestJSON-535569422-project Aug 06 14:29:57.770108 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: method: Aug 06 14:29:57.770108 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: exception: Snapshot dc864d8b-14e3-455e-9597-3e31b0678dfb could not be found. Aug 06 14:29:57.770108 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: action_args: {'id': 'dc864d8b-14e3-455e-9597-3e31b0678dfb'} Aug 06 14:29:57.770108 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 14:29:57.771043 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:29:57.771043 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 06 14:29:57.771043 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 06 14:29:57.771043 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 06 14:29:57.771043 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 06 14:29:57.771043 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 06 14:29:57.771043 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 06 14:29:57.771043 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 06 14:29:57.771043 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 06 14:29:57.771043 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 06 14:29:57.771043 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 06 14:29:57.771043 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 14:29:57.771043 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 14:29:57.771043 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 14:29:57.771043 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 14:29:57.771043 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot dc864d8b-14e3-455e-9597-3e31b0678dfb could not be found. (HTTP 404) (Request-ID: req-f2686295-50b6-462f-b190-c89a661ba86d) Aug 06 14:29:57.771043 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:29:57.771043 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:29:57.772159 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:29:57.772159 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:29:57.772159 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 06 14:29:57.772159 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 06 14:29:57.772159 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 06 14:29:57.772159 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 06 14:29:57.772159 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 06 14:29:57.772159 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 06 14:29:57.772159 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 06 14:29:57.772159 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 06 14:29:57.772159 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 06 14:29:57.772159 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 06 14:29:57.772159 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 06 14:29:57.772159 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 06 14:29:57.772159 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 06 14:29:57.772159 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 06 14:29:57.772159 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 06 14:29:57.772159 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 06 14:29:57.772159 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 06 14:29:57.773304 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 06 14:29:57.773304 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 14:29:57.773304 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 14:29:57.773304 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 14:29:57.773304 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 14:29:57.773304 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot dc864d8b-14e3-455e-9597-3e31b0678dfb could not be found. Aug 06 14:29:57.773304 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:29:57.773304 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:29:57.773304 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:29:57.773304 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:29:57.773304 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:29:57.773304 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:29:57.773304 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 14:29:57.773304 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 14:29:57.773304 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 14:29:57.773304 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 14:29:57.773304 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 14:29:57.773304 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 14:29:57.773304 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 06 14:29:57.773304 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 14:29:57.775190 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot dc864d8b-14e3-455e-9597-3e31b0678dfb could not be found. Aug 06 14:29:57.775190 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:29:57.775190 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:29:57.775190 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:29:57.775190 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:29:57.775190 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:29:57.775190 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:29:57.775190 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 14:29:57.775190 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 14:29:57.775190 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot dc864d8b-14e3-455e-9597-3e31b0678dfb could not be found. Aug 06 14:29:57.775190 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:29:57.775190 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-aee6190f-6cac-4fce-b3cf-d83d4498c187 tempest-VolumesSnapshotsTestJSON-535569422 tempest-VolumesSnapshotsTestJSON-535569422-project] Returning 404 to user: Snapshot dc864d8b-14e3-455e-9597-3e31b0678dfb could not be found. {{(pid=117837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 14:29:57.776871 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-aee6190f-6cac-4fce-b3cf-d83d4498c187 tempest-VolumesSnapshotsTestJSON-535569422 tempest-VolumesSnapshotsTestJSON-535569422-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/dc864d8b-14e3-455e-9597-3e31b0678dfb" status: 404 len: 111 microversion: 2.1 time: 0.080535 Aug 06 14:29:57.777850 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 22/27] 10.222.0.17 () {58 vars in 1251 bytes} [Sat Aug 6 14:29:57 2022] GET /compute/v2.1/os-snapshots/dc864d8b-14e3-455e-9597-3e31b0678dfb => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 06 14:29:57.796400 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-1f74f375-ea17-417a-ab2b-f985aceff577 tempest-VolumesSnapshotsTestJSON-535569422 tempest-VolumesSnapshotsTestJSON-535569422-project] Calling method '.version_select at 0x7fbab32b14c0>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:29:57.991503 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-1f74f375-ea17-417a-ab2b-f985aceff577 tempest-VolumesSnapshotsTestJSON-535569422 tempest-VolumesSnapshotsTestJSON-535569422-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/25c50b40-24bc-4991-8f14-4ad5e39ae175" status: 202 len: 0 microversion: 2.1 time: 0.200356 Aug 06 14:29:57.992337 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 23/28] 10.222.0.17 () {58 vars in 1248 bytes} [Sat Aug 6 14:29:57 2022] DELETE /compute/v2.1/os-volumes/25c50b40-24bc-4991-8f14-4ad5e39ae175 => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 14:29:58.003760 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-e8e9b449-3b0d-4301-be01-0fda45271434 tempest-VolumesSnapshotsTestJSON-535569422 tempest-VolumesSnapshotsTestJSON-535569422-project] Calling method '.version_select at 0x7fbab32a79d0>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:29:58.172364 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-e8e9b449-3b0d-4301-be01-0fda45271434 tempest-VolumesSnapshotsTestJSON-535569422 tempest-VolumesSnapshotsTestJSON-535569422-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/25c50b40-24bc-4991-8f14-4ad5e39ae175" status: 200 len: 345 microversion: 2.1 time: 0.175029 Aug 06 14:29:58.177042 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 24/29] 10.222.0.17 () {58 vars in 1245 bytes} [Sat Aug 6 14:29:57 2022] GET /compute/v2.1/os-volumes/25c50b40-24bc-4991-8f14-4ad5e39ae175 => generated 345 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 14:29:59.191372 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-5eb5a9bb-5f54-479d-9e72-dbb2b92757a1 tempest-VolumesSnapshotsTestJSON-535569422 tempest-VolumesSnapshotsTestJSON-535569422-project] Calling method '.version_select at 0x7fbab32b1a60>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:29:59.252062 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.wsgi [None req-5eb5a9bb-5f54-479d-9e72-dbb2b92757a1 tempest-VolumesSnapshotsTestJSON-535569422 tempest-VolumesSnapshotsTestJSON-535569422-project] HTTP exception thrown: Volume 25c50b40-24bc-4991-8f14-4ad5e39ae175 could not be found. Aug 06 14:29:59.257701 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-5eb5a9bb-5f54-479d-9e72-dbb2b92757a1 tempest-VolumesSnapshotsTestJSON-535569422 tempest-VolumesSnapshotsTestJSON-535569422-project] Request method failure captured: Aug 06 14:29:59.257701 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: request: GET /compute/v2.1/os-volumes/25c50b40-24bc-4991-8f14-4ad5e39ae175 HTTP/1.1 Aug 06 14:29:59.257701 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Accept: application/json Aug 06 14:29:59.257701 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Accept-Encoding: identity Aug 06 14:29:59.257701 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Connection: close Aug 06 14:29:59.257701 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Content-Length: 0 Aug 06 14:29:59.257701 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Content-Type: application/json Aug 06 14:29:59.257701 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Host: 10.222.0.17 Aug 06 14:29:59.257701 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Openstack-System-Scope: None Aug 06 14:29:59.257701 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: User-Agent: python-urllib3/1.26.11 Aug 06 14:29:59.257701 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Auth-Token: gAAAAABi7nrWwc4-zmLgDAVK4U05Gv1SyEtWXENIJfqST8aB_2BNz5ccfe-8exgTvzZn5wIVrLq2ltkmXpCSnMXKaY8XvEJoVRzIlEhGNEIW27uwQAbEhZb84HNbNhoG-WuST5lMnR6t3UGYmUUKx3HdrlJyCt90H0RhblrdRGu568P7eHXeoJ8 Aug 06 14:29:59.257701 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Domain-Id: None Aug 06 14:29:59.257701 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Domain-Name: None Aug 06 14:29:59.257701 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Identity-Status: Confirmed Aug 06 14:29:59.257701 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Is-Admin-Project: True Aug 06 14:29:59.257701 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Domain-Id: default Aug 06 14:29:59.257701 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Domain-Name: Default Aug 06 14:29:59.257701 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Id: 4ec92e2a9a9e47519d4003039ea1a0bc Aug 06 14:29:59.257701 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-535569422 Aug 06 14:29:59.257701 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Role: member,reader Aug 06 14:29:59.257701 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Roles: member,reader Aug 06 14:29:59.258823 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4ec92e2a9a9e47519d4003039ea1a0bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4ec92e2a9a9e47519d4003039ea1a0bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4ec92e2a9a9e47519d4003039ea1a0bc", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4ec92e2a9a9e47519d4003039ea1a0bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 06 14:29:59.258823 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant: tempest-VolumesSnapshotsTestJSON-535569422 Aug 06 14:29:59.258823 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant-Id: 4ec92e2a9a9e47519d4003039ea1a0bc Aug 06 14:29:59.258823 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-535569422 Aug 06 14:29:59.258823 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User: tempest-VolumesSnapshotsTestJSON-535569422-project Aug 06 14:29:59.258823 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Domain-Id: default Aug 06 14:29:59.258823 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Domain-Name: Default Aug 06 14:29:59.258823 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Id: a6275ec0936a4471a49b9a6aa1eef931 Aug 06 14:29:59.258823 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Name: tempest-VolumesSnapshotsTestJSON-535569422-project Aug 06 14:29:59.258823 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: method: Aug 06 14:29:59.258823 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: exception: Volume 25c50b40-24bc-4991-8f14-4ad5e39ae175 could not be found. Aug 06 14:29:59.258823 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: action_args: {'id': '25c50b40-24bc-4991-8f14-4ad5e39ae175'} Aug 06 14:29:59.258823 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 14:29:59.259507 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:29:59.259507 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 14:29:59.259507 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 14:29:59.259507 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 06 14:29:59.259507 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 06 14:29:59.259507 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 06 14:29:59.259507 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 06 14:29:59.259507 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 06 14:29:59.259507 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 06 14:29:59.259507 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 06 14:29:59.259507 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 06 14:29:59.259507 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 14:29:59.259507 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 14:29:59.259507 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 14:29:59.259507 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 14:29:59.259507 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 25c50b40-24bc-4991-8f14-4ad5e39ae175 could not be found. (HTTP 404) (Request-ID: req-8ad26a2f-d266-45b9-ad8a-357fa97c4ba1) Aug 06 14:29:59.259507 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:29:59.259507 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:29:59.259507 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:29:59.260433 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:29:59.260433 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 06 14:29:59.260433 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 06 14:29:59.260433 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 06 14:29:59.260433 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 06 14:29:59.260433 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 06 14:29:59.260433 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 06 14:29:59.260433 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 06 14:29:59.260433 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 06 14:29:59.260433 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 14:29:59.260433 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 14:29:59.260433 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 06 14:29:59.260433 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 06 14:29:59.260433 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 06 14:29:59.260433 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 06 14:29:59.260433 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 06 14:29:59.260433 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 06 14:29:59.260433 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 06 14:29:59.260433 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 06 14:29:59.261304 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 14:29:59.261304 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 14:29:59.261304 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 14:29:59.261304 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 14:29:59.261304 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 25c50b40-24bc-4991-8f14-4ad5e39ae175 could not be found. Aug 06 14:29:59.261304 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:29:59.261304 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:29:59.261304 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:29:59.261304 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:29:59.261304 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:29:59.261304 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:29:59.261304 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 14:29:59.261304 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 14:29:59.261304 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 14:29:59.261304 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 14:29:59.261304 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 14:29:59.261304 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 14:29:59.261304 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 06 14:29:59.261304 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 14:29:59.262170 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 25c50b40-24bc-4991-8f14-4ad5e39ae175 could not be found. Aug 06 14:29:59.262170 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:29:59.262170 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:29:59.262170 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:29:59.262170 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:29:59.262170 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:29:59.262170 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:29:59.262170 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 14:29:59.262170 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 14:29:59.262170 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 25c50b40-24bc-4991-8f14-4ad5e39ae175 could not be found. Aug 06 14:29:59.262170 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:29:59.262170 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-5eb5a9bb-5f54-479d-9e72-dbb2b92757a1 tempest-VolumesSnapshotsTestJSON-535569422 tempest-VolumesSnapshotsTestJSON-535569422-project] Returning 404 to user: Volume 25c50b40-24bc-4991-8f14-4ad5e39ae175 could not be found. {{(pid=117837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 14:29:59.262170 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-5eb5a9bb-5f54-479d-9e72-dbb2b92757a1 tempest-VolumesSnapshotsTestJSON-535569422 tempest-VolumesSnapshotsTestJSON-535569422-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/25c50b40-24bc-4991-8f14-4ad5e39ae175" status: 404 len: 109 microversion: 2.1 time: 0.072763 Aug 06 14:29:59.262170 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 25/30] 10.222.0.17 () {58 vars in 1245 bytes} [Sat Aug 6 14:29:59 2022] GET /compute/v2.1/os-volumes/25c50b40-24bc-4991-8f14-4ad5e39ae175 => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 14:29:59.283929 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-b295bcd0-0da0-4a49-b369-cfa7a04ff2f8 tempest-VolumesSnapshotsTestJSON-535569422 tempest-VolumesSnapshotsTestJSON-535569422-project] Calling method '.version_select at 0x7fbab32f69d0>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:29:59.599503 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.virt.hardware [None req-7bc20102-c500-4bc1-92b5-0b8816f61f3c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Flavor limits 0:0:0 {{(pid=117838) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 14:29:59.600660 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.virt.hardware [None req-7bc20102-c500-4bc1-92b5-0b8816f61f3c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Image limits 0:0:0 {{(pid=117838) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 14:29:59.601394 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.virt.hardware [None req-7bc20102-c500-4bc1-92b5-0b8816f61f3c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Flavor pref 0:0:0 {{(pid=117838) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 14:29:59.602680 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.virt.hardware [None req-7bc20102-c500-4bc1-92b5-0b8816f61f3c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Image pref 0:0:0 {{(pid=117838) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 14:29:59.603262 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.virt.hardware [None req-7bc20102-c500-4bc1-92b5-0b8816f61f3c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117838) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 14:29:59.622630 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7bc20102-c500-4bc1-92b5-0b8816f61f3c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:29:59.632122 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7bc20102-c500-4bc1-92b5-0b8816f61f3c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:29:59.633311 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7bc20102-c500-4bc1-92b5-0b8816f61f3c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:29:59.634638 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7bc20102-c500-4bc1-92b5-0b8816f61f3c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:29:59.637875 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7bc20102-c500-4bc1-92b5-0b8816f61f3c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:29:59.638411 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7bc20102-c500-4bc1-92b5-0b8816f61f3c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:29:59.672859 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.wsgi [None req-b295bcd0-0da0-4a49-b369-cfa7a04ff2f8 tempest-VolumesSnapshotsTestJSON-535569422 tempest-VolumesSnapshotsTestJSON-535569422-project] HTTP exception thrown: Volume 25c50b40-24bc-4991-8f14-4ad5e39ae175 could not be found. Aug 06 14:29:59.675551 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-b295bcd0-0da0-4a49-b369-cfa7a04ff2f8 tempest-VolumesSnapshotsTestJSON-535569422 tempest-VolumesSnapshotsTestJSON-535569422-project] Request method failure captured: Aug 06 14:29:59.675551 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: request: DELETE /compute/v2.1/os-volumes/25c50b40-24bc-4991-8f14-4ad5e39ae175 HTTP/1.1 Aug 06 14:29:59.675551 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Accept: application/json Aug 06 14:29:59.675551 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Accept-Encoding: identity Aug 06 14:29:59.675551 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Connection: close Aug 06 14:29:59.675551 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Content-Length: 0 Aug 06 14:29:59.675551 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Content-Type: application/json Aug 06 14:29:59.675551 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Host: 10.222.0.17 Aug 06 14:29:59.675551 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Openstack-System-Scope: None Aug 06 14:29:59.675551 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: User-Agent: python-urllib3/1.26.11 Aug 06 14:29:59.675551 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Auth-Token: gAAAAABi7nrWwc4-zmLgDAVK4U05Gv1SyEtWXENIJfqST8aB_2BNz5ccfe-8exgTvzZn5wIVrLq2ltkmXpCSnMXKaY8XvEJoVRzIlEhGNEIW27uwQAbEhZb84HNbNhoG-WuST5lMnR6t3UGYmUUKx3HdrlJyCt90H0RhblrdRGu568P7eHXeoJ8 Aug 06 14:29:59.675551 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Domain-Id: None Aug 06 14:29:59.675551 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Domain-Name: None Aug 06 14:29:59.675551 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Identity-Status: Confirmed Aug 06 14:29:59.675551 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Is-Admin-Project: True Aug 06 14:29:59.675551 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Domain-Id: default Aug 06 14:29:59.675551 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Domain-Name: Default Aug 06 14:29:59.675551 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Id: 4ec92e2a9a9e47519d4003039ea1a0bc Aug 06 14:29:59.675551 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-535569422 Aug 06 14:29:59.675551 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Role: member,reader Aug 06 14:29:59.675551 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Roles: member,reader Aug 06 14:29:59.676703 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4ec92e2a9a9e47519d4003039ea1a0bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4ec92e2a9a9e47519d4003039ea1a0bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4ec92e2a9a9e47519d4003039ea1a0bc", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4ec92e2a9a9e47519d4003039ea1a0bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 06 14:29:59.676703 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant: tempest-VolumesSnapshotsTestJSON-535569422 Aug 06 14:29:59.676703 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant-Id: 4ec92e2a9a9e47519d4003039ea1a0bc Aug 06 14:29:59.676703 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-535569422 Aug 06 14:29:59.676703 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User: tempest-VolumesSnapshotsTestJSON-535569422-project Aug 06 14:29:59.676703 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Domain-Id: default Aug 06 14:29:59.676703 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Domain-Name: Default Aug 06 14:29:59.676703 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Id: a6275ec0936a4471a49b9a6aa1eef931 Aug 06 14:29:59.676703 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Name: tempest-VolumesSnapshotsTestJSON-535569422-project Aug 06 14:29:59.676703 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: method: Aug 06 14:29:59.676703 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: exception: Volume 25c50b40-24bc-4991-8f14-4ad5e39ae175 could not be found. Aug 06 14:29:59.676703 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: action_args: {'id': '25c50b40-24bc-4991-8f14-4ad5e39ae175'} Aug 06 14:29:59.676703 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 14:29:59.677354 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:29:59.677354 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 14:29:59.677354 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 14:29:59.677354 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 06 14:29:59.677354 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 06 14:29:59.677354 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 06 14:29:59.677354 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 06 14:29:59.677354 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 06 14:29:59.677354 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 06 14:29:59.677354 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 06 14:29:59.677354 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 06 14:29:59.677354 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 14:29:59.677354 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 14:29:59.677354 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 14:29:59.677354 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 14:29:59.677354 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 25c50b40-24bc-4991-8f14-4ad5e39ae175 could not be found. (HTTP 404) (Request-ID: req-b7140a25-42bf-447e-a74c-b08c3d494a7c) Aug 06 14:29:59.677354 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:29:59.677354 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:29:59.677354 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:29:59.678247 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:29:59.678247 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 06 14:29:59.678247 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 06 14:29:59.678247 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 06 14:29:59.678247 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 06 14:29:59.678247 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 06 14:29:59.678247 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 06 14:29:59.678247 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 06 14:29:59.678247 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 06 14:29:59.678247 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 14:29:59.678247 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 14:29:59.678247 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 06 14:29:59.678247 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 06 14:29:59.678247 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 06 14:29:59.678247 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 06 14:29:59.678247 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 06 14:29:59.678247 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 06 14:29:59.678247 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 06 14:29:59.678247 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 06 14:29:59.679185 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 14:29:59.679185 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 14:29:59.679185 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 14:29:59.679185 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 14:29:59.679185 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 25c50b40-24bc-4991-8f14-4ad5e39ae175 could not be found. Aug 06 14:29:59.679185 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:29:59.679185 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:29:59.679185 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:29:59.679185 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:29:59.679185 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:29:59.679185 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:29:59.679185 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 14:29:59.679185 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 14:29:59.679185 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 14:29:59.679185 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 14:29:59.679185 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 14:29:59.679185 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 14:29:59.679185 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 06 14:29:59.679185 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 14:29:59.680460 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 25c50b40-24bc-4991-8f14-4ad5e39ae175 could not be found. Aug 06 14:29:59.680460 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:29:59.680460 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:29:59.680460 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:29:59.680460 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:29:59.680460 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:29:59.680460 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:29:59.680460 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 14:29:59.680460 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 14:29:59.680460 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 25c50b40-24bc-4991-8f14-4ad5e39ae175 could not be found. Aug 06 14:29:59.680460 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:29:59.682037 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-b295bcd0-0da0-4a49-b369-cfa7a04ff2f8 tempest-VolumesSnapshotsTestJSON-535569422 tempest-VolumesSnapshotsTestJSON-535569422-project] Returning 404 to user: Volume 25c50b40-24bc-4991-8f14-4ad5e39ae175 could not be found. {{(pid=117837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 14:29:59.683079 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-b295bcd0-0da0-4a49-b369-cfa7a04ff2f8 tempest-VolumesSnapshotsTestJSON-535569422 tempest-VolumesSnapshotsTestJSON-535569422-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/25c50b40-24bc-4991-8f14-4ad5e39ae175" status: 404 len: 109 microversion: 2.1 time: 0.404167 Aug 06 14:29:59.683786 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 26/31] 10.222.0.17 () {58 vars in 1248 bytes} [Sat Aug 6 14:29:59 2022] DELETE /compute/v2.1/os-volumes/25c50b40-24bc-4991-8f14-4ad5e39ae175 => generated 109 bytes in 405 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 14:29:59.692698 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-42f0c3e8-d447-45d2-98b0-6e6668b6a209 tempest-VolumesSnapshotsTestJSON-535569422 tempest-VolumesSnapshotsTestJSON-535569422-project] Calling method '.version_select at 0x7fbab32b1820>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:29:59.707543 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.quota [None req-7bc20102-c500-4bc1-92b5-0b8816f61f3c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Getting quotas for project d19dc46cdcf549b0a6383c8b99d6f15f. Resources: {'cores', 'instances', 'ram'} {{(pid=117838) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 14:29:59.724879 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.quota [None req-7bc20102-c500-4bc1-92b5-0b8816f61f3c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Getting quotas for user 4dadf737392d4153ae50de020534f070 and project d19dc46cdcf549b0a6383c8b99d6f15f. Resources: {'cores', 'instances', 'ram'} {{(pid=117838) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 14:29:59.763704 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-7bc20102-c500-4bc1-92b5-0b8816f61f3c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Going to run 1 instances... {{(pid=117838) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 14:29:59.767905 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-7bc20102-c500-4bc1-92b5-0b8816f61f3c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='13d7ee60-c9c3-43ee-9861-a9192a114a77',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117838) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 14:29:59.796807 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.wsgi [None req-42f0c3e8-d447-45d2-98b0-6e6668b6a209 tempest-VolumesSnapshotsTestJSON-535569422 tempest-VolumesSnapshotsTestJSON-535569422-project] HTTP exception thrown: Volume 25c50b40-24bc-4991-8f14-4ad5e39ae175 could not be found. Aug 06 14:29:59.799995 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-42f0c3e8-d447-45d2-98b0-6e6668b6a209 tempest-VolumesSnapshotsTestJSON-535569422 tempest-VolumesSnapshotsTestJSON-535569422-project] Request method failure captured: Aug 06 14:29:59.799995 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: request: GET /compute/v2.1/os-volumes/25c50b40-24bc-4991-8f14-4ad5e39ae175 HTTP/1.1 Aug 06 14:29:59.799995 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Accept: application/json Aug 06 14:29:59.799995 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Accept-Encoding: identity Aug 06 14:29:59.799995 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Connection: close Aug 06 14:29:59.799995 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Content-Length: 0 Aug 06 14:29:59.799995 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Content-Type: application/json Aug 06 14:29:59.799995 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Host: 10.222.0.17 Aug 06 14:29:59.799995 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Openstack-System-Scope: None Aug 06 14:29:59.799995 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: User-Agent: python-urllib3/1.26.11 Aug 06 14:29:59.799995 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Auth-Token: gAAAAABi7nrWwc4-zmLgDAVK4U05Gv1SyEtWXENIJfqST8aB_2BNz5ccfe-8exgTvzZn5wIVrLq2ltkmXpCSnMXKaY8XvEJoVRzIlEhGNEIW27uwQAbEhZb84HNbNhoG-WuST5lMnR6t3UGYmUUKx3HdrlJyCt90H0RhblrdRGu568P7eHXeoJ8 Aug 06 14:29:59.799995 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Domain-Id: None Aug 06 14:29:59.799995 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Domain-Name: None Aug 06 14:29:59.799995 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Identity-Status: Confirmed Aug 06 14:29:59.799995 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Is-Admin-Project: True Aug 06 14:29:59.799995 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Domain-Id: default Aug 06 14:29:59.799995 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Domain-Name: Default Aug 06 14:29:59.799995 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Id: 4ec92e2a9a9e47519d4003039ea1a0bc Aug 06 14:29:59.799995 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-535569422 Aug 06 14:29:59.799995 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Role: member,reader Aug 06 14:29:59.799995 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Roles: member,reader Aug 06 14:29:59.801544 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4ec92e2a9a9e47519d4003039ea1a0bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4ec92e2a9a9e47519d4003039ea1a0bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4ec92e2a9a9e47519d4003039ea1a0bc", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4ec92e2a9a9e47519d4003039ea1a0bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 06 14:29:59.801544 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant: tempest-VolumesSnapshotsTestJSON-535569422 Aug 06 14:29:59.801544 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant-Id: 4ec92e2a9a9e47519d4003039ea1a0bc Aug 06 14:29:59.801544 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-535569422 Aug 06 14:29:59.801544 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User: tempest-VolumesSnapshotsTestJSON-535569422-project Aug 06 14:29:59.801544 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Domain-Id: default Aug 06 14:29:59.801544 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Domain-Name: Default Aug 06 14:29:59.801544 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Id: a6275ec0936a4471a49b9a6aa1eef931 Aug 06 14:29:59.801544 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Name: tempest-VolumesSnapshotsTestJSON-535569422-project Aug 06 14:29:59.801544 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: method: Aug 06 14:29:59.801544 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: exception: Volume 25c50b40-24bc-4991-8f14-4ad5e39ae175 could not be found. Aug 06 14:29:59.801544 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: action_args: {'id': '25c50b40-24bc-4991-8f14-4ad5e39ae175'} Aug 06 14:29:59.801544 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 14:29:59.802343 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:29:59.802343 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 14:29:59.802343 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 14:29:59.802343 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 06 14:29:59.802343 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 06 14:29:59.802343 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 06 14:29:59.802343 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 06 14:29:59.802343 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 06 14:29:59.802343 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 06 14:29:59.802343 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 06 14:29:59.802343 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 06 14:29:59.802343 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 14:29:59.802343 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 14:29:59.802343 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 14:29:59.802343 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 14:29:59.802343 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 25c50b40-24bc-4991-8f14-4ad5e39ae175 could not be found. (HTTP 404) (Request-ID: req-bc34f637-a522-43cd-9890-cb82cb0c1dba) Aug 06 14:29:59.802343 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:29:59.802343 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:29:59.802343 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:29:59.803812 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:29:59.803812 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 06 14:29:59.803812 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 06 14:29:59.803812 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 06 14:29:59.803812 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 06 14:29:59.803812 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 06 14:29:59.803812 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 06 14:29:59.803812 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 06 14:29:59.803812 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 06 14:29:59.803812 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 14:29:59.803812 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 14:29:59.803812 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 06 14:29:59.803812 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 06 14:29:59.803812 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 06 14:29:59.803812 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 06 14:29:59.803812 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 06 14:29:59.803812 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 06 14:29:59.803812 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 06 14:29:59.803812 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 06 14:29:59.806309 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 14:29:59.806309 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 14:29:59.806309 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 14:29:59.806309 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 14:29:59.806309 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 25c50b40-24bc-4991-8f14-4ad5e39ae175 could not be found. Aug 06 14:29:59.806309 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:29:59.806309 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:29:59.806309 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:29:59.806309 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:29:59.806309 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:29:59.806309 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:29:59.806309 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 14:29:59.806309 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 14:29:59.806309 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 14:29:59.806309 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 14:29:59.806309 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 14:29:59.806309 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 14:29:59.806309 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 06 14:29:59.806309 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 14:29:59.808741 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 25c50b40-24bc-4991-8f14-4ad5e39ae175 could not be found. Aug 06 14:29:59.808741 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:29:59.808741 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:29:59.808741 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:29:59.808741 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:29:59.808741 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:29:59.808741 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:29:59.808741 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 14:29:59.808741 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 14:29:59.808741 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 25c50b40-24bc-4991-8f14-4ad5e39ae175 could not be found. Aug 06 14:29:59.808741 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:29:59.808741 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-42f0c3e8-d447-45d2-98b0-6e6668b6a209 tempest-VolumesSnapshotsTestJSON-535569422 tempest-VolumesSnapshotsTestJSON-535569422-project] Returning 404 to user: Volume 25c50b40-24bc-4991-8f14-4ad5e39ae175 could not be found. {{(pid=117837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 14:29:59.808741 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-42f0c3e8-d447-45d2-98b0-6e6668b6a209 tempest-VolumesSnapshotsTestJSON-535569422 tempest-VolumesSnapshotsTestJSON-535569422-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/25c50b40-24bc-4991-8f14-4ad5e39ae175" status: 404 len: 109 microversion: 2.1 time: 0.119034 Aug 06 14:29:59.808741 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 27/32] 10.222.0.17 () {58 vars in 1245 bytes} [Sat Aug 6 14:29:59 2022] GET /compute/v2.1/os-volumes/25c50b40-24bc-4991-8f14-4ad5e39ae175 => generated 109 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 06 14:29:59.937272 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-7bc20102-c500-4bc1-92b5-0b8816f61f3c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.036744 Aug 06 14:29:59.938653 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 6/33] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Aug 6 14:29:54 2022] POST /compute/v2.1/servers => generated 383 bytes in 5043 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 14:29:59.950551 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-3a8518d7-6254-486f-9cb3-981dbc7a650e tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:29:59.953124 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-3a8518d7-6254-486f-9cb3-981dbc7a650e tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:00.186622 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-3a8518d7-6254-486f-9cb3-981dbc7a650e tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:00.196543 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-3a8518d7-6254-486f-9cb3-981dbc7a650e tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1222 microversion: 2.1 time: 0.249857 Aug 06 14:30:00.208771 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 28/34] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:29:59 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1222 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:30:01.226755 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-59eb73cb-8cbe-4ddc-bdca-ed1f0144d7fa tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:01.228033 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-59eb73cb-8cbe-4ddc-bdca-ed1f0144d7fa tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:02.038376 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-59eb73cb-8cbe-4ddc-bdca-ed1f0144d7fa tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:02.091421 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-59eb73cb-8cbe-4ddc-bdca-ed1f0144d7fa tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1222 microversion: 2.1 time: 0.870001 Aug 06 14:30:02.096629 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 7/35] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:01 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1222 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:02.845967 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-76a7aec2-4c9b-406c-afbd-3c6142642fc2 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Action: 'create', calling method: .version_select at 0x7fbab32d78b0>, body: {"keypair": {"name": "tempest-keypair-1787915652", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHPiza0UJBbYHWeLskgfCBvhEl43ivErNI7koIhWjOfAhRmXQexOC68xTxlWzYNTP1GhQUdycwWcQ+EIgkUMVxnqMOIpY6Ip+Wh2rk8JOewSlIR0IV9qrDkaLwrn7y9B2A=="}} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:30:02.965366 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.quota [None req-76a7aec2-4c9b-406c-afbd-3c6142642fc2 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Getting quotas for project 2f20dc7bdc3a4448a56a76f1efbec596. Resources: {'key_pairs'} {{(pid=117837) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 14:30:02.982698 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.quota [None req-76a7aec2-4c9b-406c-afbd-3c6142642fc2 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Getting quotas for user be34f77da4d8407e9a4333bc71f64595 and project 2f20dc7bdc3a4448a56a76f1efbec596. Resources: {'key_pairs'} {{(pid=117837) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 14:30:03.117134 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-58671c07-cc00-4f16-b031-a98928fd997f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:03.117782 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-58671c07-cc00-4f16-b031-a98928fd997f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:03.144220 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-58671c07-cc00-4f16-b031-a98928fd997f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:03.144858 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-58671c07-cc00-4f16-b031-a98928fd997f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:03.145305 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-58671c07-cc00-4f16-b031-a98928fd997f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:03.146044 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-58671c07-cc00-4f16-b031-a98928fd997f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:03.146497 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-58671c07-cc00-4f16-b031-a98928fd997f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:03.147114 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-58671c07-cc00-4f16-b031-a98928fd997f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:03.194658 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-76a7aec2-4c9b-406c-afbd-3c6142642fc2 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.713342 Aug 06 14:30:03.198928 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 29/36] 10.222.0.17 () {62 vars in 1200 bytes} [Sat Aug 6 14:30:02 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 720 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 06 14:30:03.707061 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-58671c07-cc00-4f16-b031-a98928fd997f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:03.783847 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-58671c07-cc00-4f16-b031-a98928fd997f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1274 microversion: 2.1 time: 0.670485 Aug 06 14:30:03.788298 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 8/37] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:03 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1274 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:04.816786 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-0c8343e6-ece1-4406-a7b2-843ecb67180f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:04.818040 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-0c8343e6-ece1-4406-a7b2-843ecb67180f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:04.833616 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0c8343e6-ece1-4406-a7b2-843ecb67180f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:04.835561 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0c8343e6-ece1-4406-a7b2-843ecb67180f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:04.836812 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0c8343e6-ece1-4406-a7b2-843ecb67180f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:04.842312 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0c8343e6-ece1-4406-a7b2-843ecb67180f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:04.843443 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0c8343e6-ece1-4406-a7b2-843ecb67180f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:04.846820 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0c8343e6-ece1-4406-a7b2-843ecb67180f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:05.653380 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-0c8343e6-ece1-4406-a7b2-843ecb67180f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:05.705525 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-0c8343e6-ece1-4406-a7b2-843ecb67180f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1280 microversion: 2.1 time: 0.869753 Aug 06 14:30:05.709524 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 30/38] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:04 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1280 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:06.736444 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-aebac276-e80f-435f-8efa-d0b292d768eb tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:06.756689 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-aebac276-e80f-435f-8efa-d0b292d768eb tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:06.778274 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-aebac276-e80f-435f-8efa-d0b292d768eb tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:06.781338 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-aebac276-e80f-435f-8efa-d0b292d768eb tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:06.784293 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-aebac276-e80f-435f-8efa-d0b292d768eb tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:06.787811 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-aebac276-e80f-435f-8efa-d0b292d768eb tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:06.789830 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-aebac276-e80f-435f-8efa-d0b292d768eb tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:06.791591 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-aebac276-e80f-435f-8efa-d0b292d768eb tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:07.245577 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-aebac276-e80f-435f-8efa-d0b292d768eb tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:07.255960 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-aebac276-e80f-435f-8efa-d0b292d768eb tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1280 microversion: 2.1 time: 0.525274 Aug 06 14:30:07.257077 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 9/39] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:06 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1280 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:08.281410 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-a71f3e2b-380d-480a-ac98-63ce3906a529 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:08.282843 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-a71f3e2b-380d-480a-ac98-63ce3906a529 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:08.296758 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [req-4320d135-f006-4e47-8483-263ffcfc51d1 req-4cfc19d8-b44d-4382-8a6b-7132952f9668 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1cbde5c-7d9e-49cc-ba65-31507c04c60b", "tag": "a853325e-6939-4f2f-af26-cb207312c178"}]} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:30:08.301971 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a71f3e2b-380d-480a-ac98-63ce3906a529 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:08.303085 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a71f3e2b-380d-480a-ac98-63ce3906a529 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:08.303994 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a71f3e2b-380d-480a-ac98-63ce3906a529 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:08.306236 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a71f3e2b-380d-480a-ac98-63ce3906a529 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:08.307494 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a71f3e2b-380d-480a-ac98-63ce3906a529 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:08.310547 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a71f3e2b-380d-480a-ac98-63ce3906a529 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:08.384646 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-4320d135-f006-4e47-8483-263ffcfc51d1 req-4cfc19d8-b44d-4382-8a6b-7132952f9668 service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:08.385151 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-4320d135-f006-4e47-8483-263ffcfc51d1 req-4cfc19d8-b44d-4382-8a6b-7132952f9668 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:08.385889 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-4320d135-f006-4e47-8483-263ffcfc51d1 req-4cfc19d8-b44d-4382-8a6b-7132952f9668 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:08.543804 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.compute.server_external_events [req-4320d135-f006-4e47-8483-263ffcfc51d1 req-4cfc19d8-b44d-4382-8a6b-7132952f9668 service nova] Creating event network-changed:a853325e-6939-4f2f-af26-cb207312c178 for instance d1cbde5c-7d9e-49cc-ba65-31507c04c60b on hv-cinder-85199 Aug 06 14:30:08.548955 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-4320d135-f006-4e47-8483-263ffcfc51d1 req-4cfc19d8-b44d-4382-8a6b-7132952f9668 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=117837) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 06 14:30:08.551792 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-4320d135-f006-4e47-8483-263ffcfc51d1 req-4cfc19d8-b44d-4382-8a6b-7132952f9668 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117837) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 06 14:30:08.556883 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-4bf866ab-02aa-45b7-8c23-badb1dd58d5e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:08.559967 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-4bf866ab-02aa-45b7-8c23-badb1dd58d5e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:08.560477 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-4bf866ab-02aa-45b7-8c23-badb1dd58d5e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:08.561272 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-4bf866ab-02aa-45b7-8c23-badb1dd58d5e None None] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:08.561747 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-4bf866ab-02aa-45b7-8c23-badb1dd58d5e None None] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:08.564826 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-4bf866ab-02aa-45b7-8c23-badb1dd58d5e None None] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:08.586414 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-a71f3e2b-380d-480a-ac98-63ce3906a529 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:08.603304 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-a71f3e2b-380d-480a-ac98-63ce3906a529 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1280 microversion: 2.1 time: 0.325576 Aug 06 14:30:08.603512 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.compute.rpcapi [None req-4bf866ab-02aa-45b7-8c23-badb1dd58d5e None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 06 14:30:08.605367 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 10/40] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:08 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1280 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:30:08.614255 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-4bf866ab-02aa-45b7-8c23-badb1dd58d5e None None] Releasing lock "compute-rpcapi-router" {{(pid=117837) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 06 14:30:08.670297 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-4bf866ab-02aa-45b7-8c23-badb1dd58d5e None None] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.919322 Aug 06 14:30:08.671404 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 31/41] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:30:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:30:09.059301 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-6dc77acf-b6d8-4a10-97e2-f1ff3c1247e5 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Action: 'create', calling method: .version_select at 0x7fbab2157dc0>, body: {"keypair": {"name": "tempest-keypair-1989844630", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBApXB6shrOWqEqZir5w13PMT0KBrsQp+QySL8ztTsMboXzWmQ49MnpmegsFp1exeD86NfWhjUuOLEz8ULjg29trUMUiqqNuomda/kojC9wzvFAUcI78TQvis97wLYNtxfQ=="}} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:30:09.103889 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.quota [None req-6dc77acf-b6d8-4a10-97e2-f1ff3c1247e5 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Getting quotas for project 96a7bb12d3ed4d1db2a58a03472483c2. Resources: {'key_pairs'} {{(pid=117838) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 14:30:09.119050 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.quota [None req-6dc77acf-b6d8-4a10-97e2-f1ff3c1247e5 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Getting quotas for user 5378c85cd31c42dfbc39ce738a8b6dde and project 96a7bb12d3ed4d1db2a58a03472483c2. Resources: {'key_pairs'} {{(pid=117838) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 14:30:09.266324 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-6dc77acf-b6d8-4a10-97e2-f1ff3c1247e5 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.304626 Aug 06 14:30:09.286331 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 11/42] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Aug 6 14:30:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:30:09.630820 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-0aee3757-c84d-41d9-bbcc-310132d08b94 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:09.632265 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-0aee3757-c84d-41d9-bbcc-310132d08b94 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:09.645242 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0aee3757-c84d-41d9-bbcc-310132d08b94 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:09.654534 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0aee3757-c84d-41d9-bbcc-310132d08b94 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:09.655293 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0aee3757-c84d-41d9-bbcc-310132d08b94 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:09.656381 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0aee3757-c84d-41d9-bbcc-310132d08b94 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:09.656997 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0aee3757-c84d-41d9-bbcc-310132d08b94 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:09.657550 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0aee3757-c84d-41d9-bbcc-310132d08b94 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:10.029035 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-0aee3757-c84d-41d9-bbcc-310132d08b94 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:10.042993 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-0aee3757-c84d-41d9-bbcc-310132d08b94 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1280 microversion: 2.1 time: 0.416517 Aug 06 14:30:10.043712 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 32/43] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:09 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1280 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:11.072745 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-dfd97244-f05d-49cb-85d3-76aef7e6e14b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:11.077498 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-dfd97244-f05d-49cb-85d3-76aef7e6e14b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:11.095495 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_cell0:SELECT=4 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:30:11.097180 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-dfd97244-f05d-49cb-85d3-76aef7e6e14b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:11.097715 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-dfd97244-f05d-49cb-85d3-76aef7e6e14b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:11.098156 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-dfd97244-f05d-49cb-85d3-76aef7e6e14b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:11.107478 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-dfd97244-f05d-49cb-85d3-76aef7e6e14b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:11.108345 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-dfd97244-f05d-49cb-85d3-76aef7e6e14b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:11.108960 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-dfd97244-f05d-49cb-85d3-76aef7e6e14b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:11.652380 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-dfd97244-f05d-49cb-85d3-76aef7e6e14b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:11.681316 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-dfd97244-f05d-49cb-85d3-76aef7e6e14b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1280 microversion: 2.1 time: 0.613348 Aug 06 14:30:11.683814 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 12/44] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:11 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1280 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:12.708678 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-9dfe853b-fb5c-47a6-8d6d-de96c7c9cb95 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:12.709965 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-9dfe853b-fb5c-47a6-8d6d-de96c7c9cb95 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:12.718957 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9dfe853b-fb5c-47a6-8d6d-de96c7c9cb95 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:12.726587 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9dfe853b-fb5c-47a6-8d6d-de96c7c9cb95 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:12.727362 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9dfe853b-fb5c-47a6-8d6d-de96c7c9cb95 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:12.731769 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9dfe853b-fb5c-47a6-8d6d-de96c7c9cb95 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:12.732965 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9dfe853b-fb5c-47a6-8d6d-de96c7c9cb95 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:12.733837 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9dfe853b-fb5c-47a6-8d6d-de96c7c9cb95 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:12.965936 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-9dfe853b-fb5c-47a6-8d6d-de96c7c9cb95 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:12.979256 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-9dfe853b-fb5c-47a6-8d6d-de96c7c9cb95 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1280 microversion: 2.1 time: 0.274218 Aug 06 14:30:12.993774 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 13/45] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:12 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1280 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:13.028485 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_cell0:SELECT=8 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:30:13.122501 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-7bdc38a5-0297-40e4-a284-1c73f75c431c tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-643096477", "imageRef": "13d7ee60-c9c3-43ee-9861-a9192a114a77", "flavorRef": "452", "networks": [{"uuid": "696c7843-e4e0-4185-b0bb-ff3c5febf3df"}]}} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:30:13.357684 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.network.neutron [None req-7bdc38a5-0297-40e4-a284-1c73f75c431c tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] validate_networks() for [('696c7843-e4e0-4185-b0bb-ff3c5febf3df', None, None, None, None, None)] {{(pid=117837) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 14:30:14.002116 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-4358bdae-1722-44c7-b066-a8d54cad0f14 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:14.003076 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-4358bdae-1722-44c7-b066-a8d54cad0f14 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:14.011385 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=7 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:30:14.014848 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4358bdae-1722-44c7-b066-a8d54cad0f14 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:14.015375 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4358bdae-1722-44c7-b066-a8d54cad0f14 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:14.018083 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4358bdae-1722-44c7-b066-a8d54cad0f14 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:14.019778 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4358bdae-1722-44c7-b066-a8d54cad0f14 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:14.030053 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4358bdae-1722-44c7-b066-a8d54cad0f14 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:14.030514 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4358bdae-1722-44c7-b066-a8d54cad0f14 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:14.570782 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-4358bdae-1722-44c7-b066-a8d54cad0f14 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:14.585550 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-4358bdae-1722-44c7-b066-a8d54cad0f14 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1322 microversion: 2.1 time: 0.588025 Aug 06 14:30:14.602977 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 14/46] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:13 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1322 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:15.611444 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-3bde4119-e296-4ee8-9a19-30e97c49066d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:15.612226 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-3bde4119-e296-4ee8-9a19-30e97c49066d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:15.628695 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3bde4119-e296-4ee8-9a19-30e97c49066d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:15.632012 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3bde4119-e296-4ee8-9a19-30e97c49066d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:15.633906 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3bde4119-e296-4ee8-9a19-30e97c49066d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:15.639521 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3bde4119-e296-4ee8-9a19-30e97c49066d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:15.642523 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3bde4119-e296-4ee8-9a19-30e97c49066d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:15.644463 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3bde4119-e296-4ee8-9a19-30e97c49066d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:16.050466 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-3bde4119-e296-4ee8-9a19-30e97c49066d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:16.068537 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-3bde4119-e296-4ee8-9a19-30e97c49066d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1322 microversion: 2.1 time: 0.462220 Aug 06 14:30:16.087227 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 15/47] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:15 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1322 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:30:16.998276 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-22eb8bcc-1862-4c10-802a-e9c13e0a0e14 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1533409282", "imageRef": "13d7ee60-c9c3-43ee-9861-a9192a114a77", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e572c0f4-0bb9-43af-bf1a-152c1e064c44"}], "security_groups": [{"name": "tempest-securitygroup--2024378667"}], "key_name": "tempest-keypair-1787915652", "user_data": "}} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:30:17.186172 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.virt.hardware [None req-7bdc38a5-0297-40e4-a284-1c73f75c431c tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Flavor limits 0:0:0 {{(pid=117837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 14:30:17.187354 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.virt.hardware [None req-7bdc38a5-0297-40e4-a284-1c73f75c431c tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Image limits 0:0:0 {{(pid=117837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 14:30:17.187984 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.virt.hardware [None req-7bdc38a5-0297-40e4-a284-1c73f75c431c tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Flavor pref 0:0:0 {{(pid=117837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 14:30:17.188546 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.virt.hardware [None req-7bdc38a5-0297-40e4-a284-1c73f75c431c tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Image pref 0:0:0 {{(pid=117837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 14:30:17.189109 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.virt.hardware [None req-7bdc38a5-0297-40e4-a284-1c73f75c431c tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 14:30:17.229959 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7bdc38a5-0297-40e4-a284-1c73f75c431c tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:17.231983 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7bdc38a5-0297-40e4-a284-1c73f75c431c tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:17.238546 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7bdc38a5-0297-40e4-a284-1c73f75c431c tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:17.239597 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7bdc38a5-0297-40e4-a284-1c73f75c431c tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:17.242552 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7bdc38a5-0297-40e4-a284-1c73f75c431c tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:17.244151 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7bdc38a5-0297-40e4-a284-1c73f75c431c tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:17.385155 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.quota [None req-7bdc38a5-0297-40e4-a284-1c73f75c431c tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Getting quotas for project f7ead8c81ff3486683d21f671acac6e0. Resources: {'cores', 'instances', 'ram'} {{(pid=117837) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 14:30:17.412772 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.quota [None req-7bdc38a5-0297-40e4-a284-1c73f75c431c tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Getting quotas for user 8a1e8506e8b34a8d9c59b4acdbf23bb8 and project f7ead8c81ff3486683d21f671acac6e0. Resources: {'cores', 'instances', 'ram'} {{(pid=117837) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 14:30:17.508765 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-7bdc38a5-0297-40e4-a284-1c73f75c431c tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Going to run 1 instances... {{(pid=117837) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 14:30:17.535583 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-7bdc38a5-0297-40e4-a284-1c73f75c431c tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] [instance: 0604e338-9ab8-40db-a076-0fb13ba92f24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='13d7ee60-c9c3-43ee-9861-a9192a114a77',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117837) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 14:30:17.901363 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-7bdc38a5-0297-40e4-a284-1c73f75c431c tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.237999 Aug 06 14:30:17.902634 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 33/48] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Aug 6 14:30:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 5240 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 14:30:17.908212 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-b14c5c95-9776-4e90-9f74-35a873ab31f1 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:17.913245 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-b14c5c95-9776-4e90-9f74-35a873ab31f1 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:17.940846 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.network.neutron [None req-22eb8bcc-1862-4c10-802a-e9c13e0a0e14 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] validate_networks() for [('e572c0f4-0bb9-43af-bf1a-152c1e064c44', None, None, None, None, None)] {{(pid=117838) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 14:30:17.965583 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b14c5c95-9776-4e90-9f74-35a873ab31f1 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:17.965583 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b14c5c95-9776-4e90-9f74-35a873ab31f1 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:17.965583 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b14c5c95-9776-4e90-9f74-35a873ab31f1 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:17.965583 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b14c5c95-9776-4e90-9f74-35a873ab31f1 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:17.967466 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b14c5c95-9776-4e90-9f74-35a873ab31f1 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:17.967466 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b14c5c95-9776-4e90-9f74-35a873ab31f1 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:19.165959 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_cell0:SELECT=18 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:30:19.378560 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.virt.hardware [None req-22eb8bcc-1862-4c10-802a-e9c13e0a0e14 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Flavor limits 0:0:0 {{(pid=117838) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 14:30:19.379405 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.virt.hardware [None req-22eb8bcc-1862-4c10-802a-e9c13e0a0e14 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Image limits 0:0:0 {{(pid=117838) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 14:30:19.381235 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.virt.hardware [None req-22eb8bcc-1862-4c10-802a-e9c13e0a0e14 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Flavor pref 0:0:0 {{(pid=117838) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 14:30:19.382271 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.virt.hardware [None req-22eb8bcc-1862-4c10-802a-e9c13e0a0e14 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Image pref 0:0:0 {{(pid=117838) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 14:30:19.384390 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.virt.hardware [None req-22eb8bcc-1862-4c10-802a-e9c13e0a0e14 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117838) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 14:30:19.414825 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-22eb8bcc-1862-4c10-802a-e9c13e0a0e14 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:19.416382 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-22eb8bcc-1862-4c10-802a-e9c13e0a0e14 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:19.418124 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-22eb8bcc-1862-4c10-802a-e9c13e0a0e14 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:19.422208 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-22eb8bcc-1862-4c10-802a-e9c13e0a0e14 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:19.426723 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-22eb8bcc-1862-4c10-802a-e9c13e0a0e14 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:19.428066 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-22eb8bcc-1862-4c10-802a-e9c13e0a0e14 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:19.509871 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.quota [None req-22eb8bcc-1862-4c10-802a-e9c13e0a0e14 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Getting quotas for project 2f20dc7bdc3a4448a56a76f1efbec596. Resources: {'cores', 'instances', 'ram'} {{(pid=117838) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 14:30:19.515906 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.quota [None req-22eb8bcc-1862-4c10-802a-e9c13e0a0e14 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Getting quotas for user be34f77da4d8407e9a4333bc71f64595 and project 2f20dc7bdc3a4448a56a76f1efbec596. Resources: {'cores', 'instances', 'ram'} {{(pid=117838) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 14:30:19.536294 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-22eb8bcc-1862-4c10-802a-e9c13e0a0e14 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Going to run 1 instances... {{(pid=117838) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 14:30:19.543882 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-22eb8bcc-1862-4c10-802a-e9c13e0a0e14 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='13d7ee60-c9c3-43ee-9861-a9192a114a77',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117838) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 14:30:19.616281 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-b14c5c95-9776-4e90-9f74-35a873ab31f1 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:19.638487 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-b14c5c95-9776-4e90-9f74-35a873ab31f1 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1322 microversion: 2.1 time: 1.730325 Aug 06 14:30:19.642242 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 34/49] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:17 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1322 bytes in 1739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:19.736868 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-22eb8bcc-1862-4c10-802a-e9c13e0a0e14 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.744051 Aug 06 14:30:19.753833 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 16/50] 10.222.0.17 () {62 vars in 1188 bytes} [Sat Aug 6 14:30:16 2022] POST /compute/v2.1/servers => generated 402 bytes in 2762 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 06 14:30:19.790839 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-fedca15b-a918-4f49-963f-46824f3c67f0 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:19.795129 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-fedca15b-a918-4f49-963f-46824f3c67f0 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] [instance: 0604e338-9ab8-40db-a076-0fb13ba92f24] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:19.826524 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-fedca15b-a918-4f49-963f-46824f3c67f0 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:19.832744 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-fedca15b-a918-4f49-963f-46824f3c67f0 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:19.834771 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-fedca15b-a918-4f49-963f-46824f3c67f0 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:19.842050 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-fedca15b-a918-4f49-963f-46824f3c67f0 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:19.843272 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-fedca15b-a918-4f49-963f-46824f3c67f0 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:19.850604 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-fedca15b-a918-4f49-963f-46824f3c67f0 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:20.139609 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-fedca15b-a918-4f49-963f-46824f3c67f0 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1e8506e8b34a8d9c59b4acdbf23bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ead8c81ff3486683d21f671acac6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:20.151847 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-fedca15b-a918-4f49-963f-46824f3c67f0 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] 10.222.0.17 "GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24" status: 200 len: 1218 microversion: 2.1 time: 0.395634 Aug 06 14:30:20.158485 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 17/51] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:19 2022] GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24 => generated 1218 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:20.178893 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-e1276230-ff75-45a6-a770-421a35c6921b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:20.199873 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-e1276230-ff75-45a6-a770-421a35c6921b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:20.433099 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-bcafc8d8-c4da-4769-a189-91e634841d84 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Action: 'create', calling method: .version_select at 0x7fbab1849a60>, body: {"keypair": {"name": "tempest-keypair-1874721494", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH5q/qecmCnNTJgurrsh6PBT7q/sx0R+jyavJMPqSIZdSzDlHNQNbMHYCdlsKl2/lDSMSyTGQnNUCzNO2MqBv1V1YQwunPVHME2PqNbJWvLxC3ZRpUyN/s8TO+iEjbI1Cg=="}} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:30:20.481025 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.quota [None req-bcafc8d8-c4da-4769-a189-91e634841d84 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Getting quotas for project c17d83661330425d8c75a2562df8e16e. Resources: {'key_pairs'} {{(pid=117837) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 14:30:20.489733 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-e1276230-ff75-45a6-a770-421a35c6921b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:20.508515 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-e1276230-ff75-45a6-a770-421a35c6921b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:20.508689 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.quota [None req-bcafc8d8-c4da-4769-a189-91e634841d84 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Getting quotas for user a3e987dfd35f4a5da36d5034970fcf59 and project c17d83661330425d8c75a2562df8e16e. Resources: {'key_pairs'} {{(pid=117837) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 14:30:20.517589 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-e1276230-ff75-45a6-a770-421a35c6921b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:20.528320 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-e1276230-ff75-45a6-a770-421a35c6921b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1282 microversion: 2.20 time: 0.364192 Aug 06 14:30:20.529135 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 18/52] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:30:20 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1282 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:30:20.611452 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-bcafc8d8-c4da-4769-a189-91e634841d84 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.948905 Aug 06 14:30:20.619260 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 35/53] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Aug 6 14:30:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:30:20.652475 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-be7a0054-1179-4fa7-90bd-7f337ddd41d2 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-860817568", "imageRef": "13d7ee60-c9c3-43ee-9861-a9192a114a77", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9b050990-e64f-42d3-84c7-d36c3ef1c328"}], "security_groups": [{"name": "tempest-securitygroup--1789995115"}], "key_name": "tempest-keypair-1989844630", "user_data": "}} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:30:20.667482 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-905e9325-294f-4ac2-aebf-4f2a6346d015 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:20.668104 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-905e9325-294f-4ac2-aebf-4f2a6346d015 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:20.678471 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-905e9325-294f-4ac2-aebf-4f2a6346d015 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:20.684621 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-905e9325-294f-4ac2-aebf-4f2a6346d015 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:20.689630 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-905e9325-294f-4ac2-aebf-4f2a6346d015 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:20.697426 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-905e9325-294f-4ac2-aebf-4f2a6346d015 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:20.698131 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-905e9325-294f-4ac2-aebf-4f2a6346d015 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:20.698591 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-905e9325-294f-4ac2-aebf-4f2a6346d015 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:20.883578 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.network.neutron [None req-be7a0054-1179-4fa7-90bd-7f337ddd41d2 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] validate_networks() for [('9b050990-e64f-42d3-84c7-d36c3ef1c328', None, None, None, None, None)] {{(pid=117838) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 14:30:21.084302 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-905e9325-294f-4ac2-aebf-4f2a6346d015 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:21.093740 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-905e9325-294f-4ac2-aebf-4f2a6346d015 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1322 microversion: 2.1 time: 0.430587 Aug 06 14:30:21.094318 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 36/54] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:20 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1322 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:21.182628 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-5c8db7c7-a71e-4cb0-aa44-b8daf06a4e61 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:21.183682 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-5c8db7c7-a71e-4cb0-aa44-b8daf06a4e61 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] [instance: 0604e338-9ab8-40db-a076-0fb13ba92f24] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:21.204870 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-5c8db7c7-a71e-4cb0-aa44-b8daf06a4e61 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:21.205497 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-5c8db7c7-a71e-4cb0-aa44-b8daf06a4e61 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:21.206076 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-5c8db7c7-a71e-4cb0-aa44-b8daf06a4e61 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:21.207062 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-5c8db7c7-a71e-4cb0-aa44-b8daf06a4e61 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:21.207636 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-5c8db7c7-a71e-4cb0-aa44-b8daf06a4e61 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:21.208348 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-5c8db7c7-a71e-4cb0-aa44-b8daf06a4e61 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:21.442950 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-5c8db7c7-a71e-4cb0-aa44-b8daf06a4e61 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1e8506e8b34a8d9c59b4acdbf23bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ead8c81ff3486683d21f671acac6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:21.457941 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-5c8db7c7-a71e-4cb0-aa44-b8daf06a4e61 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] 10.222.0.17 "GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24" status: 200 len: 1266 microversion: 2.1 time: 0.279825 Aug 06 14:30:21.462165 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 37/55] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:21 2022] GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24 => generated 1266 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:30:21.554349 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-a53102b0-cf72-447c-a427-282d6cbe5325 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:21.555986 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-a53102b0-cf72-447c-a427-282d6cbe5325 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:21.565391 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a53102b0-cf72-447c-a427-282d6cbe5325 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:21.565885 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a53102b0-cf72-447c-a427-282d6cbe5325 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:21.570557 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a53102b0-cf72-447c-a427-282d6cbe5325 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:21.571344 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a53102b0-cf72-447c-a427-282d6cbe5325 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:21.571817 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a53102b0-cf72-447c-a427-282d6cbe5325 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:21.572248 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a53102b0-cf72-447c-a427-282d6cbe5325 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:21.737738 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-a53102b0-cf72-447c-a427-282d6cbe5325 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:21.753575 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-a53102b0-cf72-447c-a427-282d6cbe5325 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:21.755204 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-a53102b0-cf72-447c-a427-282d6cbe5325 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:21.764573 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-a53102b0-cf72-447c-a427-282d6cbe5325 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1286 microversion: 2.20 time: 0.214614 Aug 06 14:30:21.765348 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 38/56] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:30:21 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1286 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 14:30:21.770078 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.virt.hardware [None req-be7a0054-1179-4fa7-90bd-7f337ddd41d2 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Flavor limits 0:0:0 {{(pid=117838) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 14:30:21.771276 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.virt.hardware [None req-be7a0054-1179-4fa7-90bd-7f337ddd41d2 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Image limits 0:0:0 {{(pid=117838) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 14:30:21.772030 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.virt.hardware [None req-be7a0054-1179-4fa7-90bd-7f337ddd41d2 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Flavor pref 0:0:0 {{(pid=117838) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 14:30:21.772667 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.virt.hardware [None req-be7a0054-1179-4fa7-90bd-7f337ddd41d2 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Image pref 0:0:0 {{(pid=117838) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 14:30:21.774463 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.virt.hardware [None req-be7a0054-1179-4fa7-90bd-7f337ddd41d2 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117838) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 14:30:21.787274 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [req-b214441f-b21d-43d5-8075-ff5750261acc req-a8b6601a-241f-42e2-95e7-ac719bc0437b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02ac0364-de9e-4a71-8210-dc3fcd23a33e", "tag": "d9afb021-ae4d-4646-9676-3bc5246cf024"}]} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:30:21.795591 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-be7a0054-1179-4fa7-90bd-7f337ddd41d2 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:21.797206 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-be7a0054-1179-4fa7-90bd-7f337ddd41d2 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:21.798928 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-be7a0054-1179-4fa7-90bd-7f337ddd41d2 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:21.803158 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-be7a0054-1179-4fa7-90bd-7f337ddd41d2 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:21.805962 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-be7a0054-1179-4fa7-90bd-7f337ddd41d2 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:21.807461 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-be7a0054-1179-4fa7-90bd-7f337ddd41d2 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:21.820548 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-b214441f-b21d-43d5-8075-ff5750261acc req-a8b6601a-241f-42e2-95e7-ac719bc0437b service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:21.821780 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-b214441f-b21d-43d5-8075-ff5750261acc req-a8b6601a-241f-42e2-95e7-ac719bc0437b service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:21.824114 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-b214441f-b21d-43d5-8075-ff5750261acc req-a8b6601a-241f-42e2-95e7-ac719bc0437b service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:21.854199 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.compute.server_external_events [req-b214441f-b21d-43d5-8075-ff5750261acc req-a8b6601a-241f-42e2-95e7-ac719bc0437b service nova] Creating event network-changed:d9afb021-ae4d-4646-9676-3bc5246cf024 for instance 02ac0364-de9e-4a71-8210-dc3fcd23a33e on hv-cinder-85199 Aug 06 14:30:21.874066 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [req-b214441f-b21d-43d5-8075-ff5750261acc req-a8b6601a-241f-42e2-95e7-ac719bc0437b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099710 Aug 06 14:30:21.877959 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 39/57] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:30:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:30:21.879871 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.quota [None req-be7a0054-1179-4fa7-90bd-7f337ddd41d2 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Getting quotas for project 96a7bb12d3ed4d1db2a58a03472483c2. Resources: {'cores', 'instances', 'ram'} {{(pid=117838) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 14:30:21.887747 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.quota [None req-be7a0054-1179-4fa7-90bd-7f337ddd41d2 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Getting quotas for user 5378c85cd31c42dfbc39ce738a8b6dde and project 96a7bb12d3ed4d1db2a58a03472483c2. Resources: {'cores', 'instances', 'ram'} {{(pid=117838) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 14:30:21.904084 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-be7a0054-1179-4fa7-90bd-7f337ddd41d2 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Going to run 1 instances... {{(pid=117838) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 14:30:21.906619 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-be7a0054-1179-4fa7-90bd-7f337ddd41d2 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6e717f01-c854-444e-9872-51e2c1c78987] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='13d7ee60-c9c3-43ee-9861-a9192a114a77',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117838) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 14:30:21.991554 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-be7a0054-1179-4fa7-90bd-7f337ddd41d2 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.344979 Aug 06 14:30:21.992246 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 19/58] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Aug 6 14:30:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 1347 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 14:30:22.006396 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-0edd3ea1-c045-45ce-99ea-00bd62b8241d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:22.007230 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-0edd3ea1-c045-45ce-99ea-00bd62b8241d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6e717f01-c854-444e-9872-51e2c1c78987] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:22.113744 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-fe265a00-add4-40ca-8611-ac3634666a3d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:22.114354 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-fe265a00-add4-40ca-8611-ac3634666a3d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:22.123132 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-fe265a00-add4-40ca-8611-ac3634666a3d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:22.123616 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-fe265a00-add4-40ca-8611-ac3634666a3d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:22.124048 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-fe265a00-add4-40ca-8611-ac3634666a3d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:22.124773 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-fe265a00-add4-40ca-8611-ac3634666a3d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:22.128725 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-fe265a00-add4-40ca-8611-ac3634666a3d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:22.129190 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-fe265a00-add4-40ca-8611-ac3634666a3d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:22.204074 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-0edd3ea1-c045-45ce-99ea-00bd62b8241d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:22.212530 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-0edd3ea1-c045-45ce-99ea-00bd62b8241d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987" status: 200 len: 1241 microversion: 2.1 time: 0.211604 Aug 06 14:30:22.213990 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 40/59] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:21 2022] GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987 => generated 1241 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:22.483673 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-69baf2da-acf6-4dd5-95b1-fc834bb0f2c1 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:22.486139 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-69baf2da-acf6-4dd5-95b1-fc834bb0f2c1 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] [instance: 0604e338-9ab8-40db-a076-0fb13ba92f24] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:22.496314 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-69baf2da-acf6-4dd5-95b1-fc834bb0f2c1 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:22.496822 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-69baf2da-acf6-4dd5-95b1-fc834bb0f2c1 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:22.497255 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-69baf2da-acf6-4dd5-95b1-fc834bb0f2c1 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:22.504449 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-69baf2da-acf6-4dd5-95b1-fc834bb0f2c1 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:22.505134 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-69baf2da-acf6-4dd5-95b1-fc834bb0f2c1 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:22.505840 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-69baf2da-acf6-4dd5-95b1-fc834bb0f2c1 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:22.622343 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-fe265a00-add4-40ca-8611-ac3634666a3d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:22.637318 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-69baf2da-acf6-4dd5-95b1-fc834bb0f2c1 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1e8506e8b34a8d9c59b4acdbf23bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ead8c81ff3486683d21f671acac6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:22.644169 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-fe265a00-add4-40ca-8611-ac3634666a3d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1322 microversion: 2.1 time: 0.522838 Aug 06 14:30:22.644949 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 20/60] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:22 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1322 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:22.647585 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-69baf2da-acf6-4dd5-95b1-fc834bb0f2c1 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] 10.222.0.17 "GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24" status: 200 len: 1266 microversion: 2.1 time: 0.170564 Aug 06 14:30:22.658403 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 41/61] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:22 2022] GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24 => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:30:22.791660 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-912df8b0-0a97-40f0-8cd4-ac9af3f7e65c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:22.792458 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-912df8b0-0a97-40f0-8cd4-ac9af3f7e65c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:22.806765 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-912df8b0-0a97-40f0-8cd4-ac9af3f7e65c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:22.807528 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-912df8b0-0a97-40f0-8cd4-ac9af3f7e65c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:22.808074 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-912df8b0-0a97-40f0-8cd4-ac9af3f7e65c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:22.809073 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-912df8b0-0a97-40f0-8cd4-ac9af3f7e65c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:22.809818 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-912df8b0-0a97-40f0-8cd4-ac9af3f7e65c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:22.810548 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-912df8b0-0a97-40f0-8cd4-ac9af3f7e65c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:23.004264 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-912df8b0-0a97-40f0-8cd4-ac9af3f7e65c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:23.017386 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-912df8b0-0a97-40f0-8cd4-ac9af3f7e65c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:23.021468 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-912df8b0-0a97-40f0-8cd4-ac9af3f7e65c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:23.026196 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-912df8b0-0a97-40f0-8cd4-ac9af3f7e65c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1286 microversion: 2.20 time: 0.235372 Aug 06 14:30:23.039973 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 21/62] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:30:22 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1286 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:30:23.235860 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-63473423-3e50-44e3-99f7-41417ead9f3b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:23.236234 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-63473423-3e50-44e3-99f7-41417ead9f3b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6e717f01-c854-444e-9872-51e2c1c78987] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:23.247946 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-63473423-3e50-44e3-99f7-41417ead9f3b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:23.250422 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-63473423-3e50-44e3-99f7-41417ead9f3b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:23.251063 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-63473423-3e50-44e3-99f7-41417ead9f3b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:23.252130 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-63473423-3e50-44e3-99f7-41417ead9f3b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:23.253096 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-63473423-3e50-44e3-99f7-41417ead9f3b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:23.254218 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-63473423-3e50-44e3-99f7-41417ead9f3b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:23.342796 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-63473423-3e50-44e3-99f7-41417ead9f3b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:23.354901 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-63473423-3e50-44e3-99f7-41417ead9f3b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987" status: 200 len: 1245 microversion: 2.1 time: 0.125051 Aug 06 14:30:23.357579 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 42/63] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:23 2022] GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987 => generated 1245 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:23.666068 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-b0a30fe1-c8f9-4b25-bdd6-c778e63d1e51 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:23.666993 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-b0a30fe1-c8f9-4b25-bdd6-c778e63d1e51 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:23.669954 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-31d1ffd8-1394-49bd-9b20-72dd4dbc2552 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:23.670776 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-31d1ffd8-1394-49bd-9b20-72dd4dbc2552 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] [instance: 0604e338-9ab8-40db-a076-0fb13ba92f24] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:23.682563 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b0a30fe1-c8f9-4b25-bdd6-c778e63d1e51 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:23.683081 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b0a30fe1-c8f9-4b25-bdd6-c778e63d1e51 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:23.683511 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b0a30fe1-c8f9-4b25-bdd6-c778e63d1e51 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:23.691751 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b0a30fe1-c8f9-4b25-bdd6-c778e63d1e51 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:23.694321 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b0a30fe1-c8f9-4b25-bdd6-c778e63d1e51 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:23.695887 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-31d1ffd8-1394-49bd-9b20-72dd4dbc2552 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:23.696427 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b0a30fe1-c8f9-4b25-bdd6-c778e63d1e51 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:23.697109 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-31d1ffd8-1394-49bd-9b20-72dd4dbc2552 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:23.698298 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-31d1ffd8-1394-49bd-9b20-72dd4dbc2552 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:23.699396 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-31d1ffd8-1394-49bd-9b20-72dd4dbc2552 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:23.700026 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-31d1ffd8-1394-49bd-9b20-72dd4dbc2552 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:23.700663 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-31d1ffd8-1394-49bd-9b20-72dd4dbc2552 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:23.701198 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_cell1:SELECT=69 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:30:23.854689 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-31d1ffd8-1394-49bd-9b20-72dd4dbc2552 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1e8506e8b34a8d9c59b4acdbf23bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ead8c81ff3486683d21f671acac6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:23.866698 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-31d1ffd8-1394-49bd-9b20-72dd4dbc2552 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] 10.222.0.17 "GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24" status: 200 len: 1266 microversion: 2.1 time: 0.200660 Aug 06 14:30:23.867747 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 43/64] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:23 2022] GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24 => generated 1266 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:30:23.971584 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-57d5891d-0623-4a4d-9416-5d692fb6c61b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-803872769", "imageRef": "13d7ee60-c9c3-43ee-9861-a9192a114a77", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "34c7591e-0655-4c97-99f3-35953970c98c"}], "security_groups": [{"name": "tempest-securitygroup--462424075"}], "key_name": "tempest-keypair-1874721494", "user_data": "}} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:30:24.002387 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-b0a30fe1-c8f9-4b25-bdd6-c778e63d1e51 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:24.014708 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-b0a30fe1-c8f9-4b25-bdd6-c778e63d1e51 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1322 microversion: 2.1 time: 0.350162 Aug 06 14:30:24.016053 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 22/65] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:23 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1322 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:24.050775 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-fdb8ce31-2443-4ddc-873b-81dcff37bcd5 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:24.051735 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-fdb8ce31-2443-4ddc-873b-81dcff37bcd5 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:24.060308 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-fdb8ce31-2443-4ddc-873b-81dcff37bcd5 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:24.062324 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-fdb8ce31-2443-4ddc-873b-81dcff37bcd5 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:24.063864 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-fdb8ce31-2443-4ddc-873b-81dcff37bcd5 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:24.065400 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-fdb8ce31-2443-4ddc-873b-81dcff37bcd5 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:24.066166 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-fdb8ce31-2443-4ddc-873b-81dcff37bcd5 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:24.068000 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-fdb8ce31-2443-4ddc-873b-81dcff37bcd5 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:24.146488 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.network.neutron [None req-57d5891d-0623-4a4d-9416-5d692fb6c61b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] validate_networks() for [('34c7591e-0655-4c97-99f3-35953970c98c', None, None, None, None, None)] {{(pid=117837) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 14:30:24.166298 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-fdb8ce31-2443-4ddc-873b-81dcff37bcd5 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:24.177769 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-fdb8ce31-2443-4ddc-873b-81dcff37bcd5 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:24.180696 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-fdb8ce31-2443-4ddc-873b-81dcff37bcd5 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:24.182151 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-fdb8ce31-2443-4ddc-873b-81dcff37bcd5 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1286 microversion: 2.20 time: 0.135934 Aug 06 14:30:24.183451 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 23/66] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:30:24 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1286 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:30:24.351057 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=5 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:30:24.385324 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-e85ab220-c68b-4c44-9ef3-f60046f302b1 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:24.386169 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-e85ab220-c68b-4c44-9ef3-f60046f302b1 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6e717f01-c854-444e-9872-51e2c1c78987] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:24.394343 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e85ab220-c68b-4c44-9ef3-f60046f302b1 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:24.394987 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e85ab220-c68b-4c44-9ef3-f60046f302b1 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:24.395530 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e85ab220-c68b-4c44-9ef3-f60046f302b1 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:24.396344 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e85ab220-c68b-4c44-9ef3-f60046f302b1 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:24.396906 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e85ab220-c68b-4c44-9ef3-f60046f302b1 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:24.397434 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e85ab220-c68b-4c44-9ef3-f60046f302b1 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:24.502321 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-e85ab220-c68b-4c44-9ef3-f60046f302b1 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:24.512620 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-e85ab220-c68b-4c44-9ef3-f60046f302b1 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987" status: 200 len: 1245 microversion: 2.1 time: 0.138865 Aug 06 14:30:24.515601 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 24/67] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:24 2022] GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987 => generated 1245 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:24.616423 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.virt.hardware [None req-57d5891d-0623-4a4d-9416-5d692fb6c61b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Flavor limits 0:0:0 {{(pid=117837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 14:30:24.617569 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.virt.hardware [None req-57d5891d-0623-4a4d-9416-5d692fb6c61b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Image limits 0:0:0 {{(pid=117837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 14:30:24.618248 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.virt.hardware [None req-57d5891d-0623-4a4d-9416-5d692fb6c61b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Flavor pref 0:0:0 {{(pid=117837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 14:30:24.618861 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.virt.hardware [None req-57d5891d-0623-4a4d-9416-5d692fb6c61b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Image pref 0:0:0 {{(pid=117837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 14:30:24.619655 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.virt.hardware [None req-57d5891d-0623-4a4d-9416-5d692fb6c61b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 14:30:24.630663 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-57d5891d-0623-4a4d-9416-5d692fb6c61b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:24.631298 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-57d5891d-0623-4a4d-9416-5d692fb6c61b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:24.632019 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-57d5891d-0623-4a4d-9416-5d692fb6c61b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:24.633659 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-57d5891d-0623-4a4d-9416-5d692fb6c61b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:24.634331 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-57d5891d-0623-4a4d-9416-5d692fb6c61b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:24.634765 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-57d5891d-0623-4a4d-9416-5d692fb6c61b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:24.661631 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.quota [None req-57d5891d-0623-4a4d-9416-5d692fb6c61b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Getting quotas for project c17d83661330425d8c75a2562df8e16e. Resources: {'cores', 'instances', 'ram'} {{(pid=117837) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 14:30:24.666638 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.quota [None req-57d5891d-0623-4a4d-9416-5d692fb6c61b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Getting quotas for user a3e987dfd35f4a5da36d5034970fcf59 and project c17d83661330425d8c75a2562df8e16e. Resources: {'cores', 'instances', 'ram'} {{(pid=117837) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 14:30:24.679069 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-57d5891d-0623-4a4d-9416-5d692fb6c61b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Going to run 1 instances... {{(pid=117837) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 14:30:24.682167 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-57d5891d-0623-4a4d-9416-5d692fb6c61b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='13d7ee60-c9c3-43ee-9861-a9192a114a77',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117837) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 14:30:24.733610 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-57d5891d-0623-4a4d-9416-5d692fb6c61b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.767448 Aug 06 14:30:24.734592 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 44/68] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Aug 6 14:30:23 2022] POST /compute/v2.1/servers => generated 401 bytes in 769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 14:30:24.745165 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-535184d1-6d56-4c88-b549-b76f64eeaf7e tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:24.746004 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-535184d1-6d56-4c88-b549-b76f64eeaf7e tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:24.818001 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-535184d1-6d56-4c88-b549-b76f64eeaf7e tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:24.827716 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-535184d1-6d56-4c88-b549-b76f64eeaf7e tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1237 microversion: 2.1 time: 0.086167 Aug 06 14:30:24.839771 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 25/69] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:24 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1237 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:24.890113 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-891510b6-845b-4337-a2b9-b705e7ad1639 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:24.891113 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-891510b6-845b-4337-a2b9-b705e7ad1639 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] [instance: 0604e338-9ab8-40db-a076-0fb13ba92f24] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:24.906653 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-891510b6-845b-4337-a2b9-b705e7ad1639 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:24.907088 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-891510b6-845b-4337-a2b9-b705e7ad1639 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:24.907499 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-891510b6-845b-4337-a2b9-b705e7ad1639 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:24.908216 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-891510b6-845b-4337-a2b9-b705e7ad1639 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:24.909617 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-891510b6-845b-4337-a2b9-b705e7ad1639 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:24.910100 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-891510b6-845b-4337-a2b9-b705e7ad1639 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:25.009848 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-891510b6-845b-4337-a2b9-b705e7ad1639 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1e8506e8b34a8d9c59b4acdbf23bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ead8c81ff3486683d21f671acac6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:25.035546 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-891510b6-845b-4337-a2b9-b705e7ad1639 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] 10.222.0.17 "GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24" status: 200 len: 1266 microversion: 2.1 time: 0.140261 Aug 06 14:30:25.036822 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 45/70] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:24 2022] GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:25.047952 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-0b318ab6-43a6-4e4c-984a-840c56f5f224 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:25.048755 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-0b318ab6-43a6-4e4c-984a-840c56f5f224 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:25.057604 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0b318ab6-43a6-4e4c-984a-840c56f5f224 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:25.058394 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0b318ab6-43a6-4e4c-984a-840c56f5f224 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:25.059058 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0b318ab6-43a6-4e4c-984a-840c56f5f224 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:25.059979 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0b318ab6-43a6-4e4c-984a-840c56f5f224 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:25.060612 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0b318ab6-43a6-4e4c-984a-840c56f5f224 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:25.061228 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0b318ab6-43a6-4e4c-984a-840c56f5f224 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:25.205162 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-1464bd75-6742-4ce5-96a1-1030b1d2f7eb tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:25.206017 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-1464bd75-6742-4ce5-96a1-1030b1d2f7eb tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:25.217583 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1464bd75-6742-4ce5-96a1-1030b1d2f7eb tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:25.219351 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1464bd75-6742-4ce5-96a1-1030b1d2f7eb tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:25.221931 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1464bd75-6742-4ce5-96a1-1030b1d2f7eb tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:25.222826 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1464bd75-6742-4ce5-96a1-1030b1d2f7eb tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:25.224758 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1464bd75-6742-4ce5-96a1-1030b1d2f7eb tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:25.225346 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1464bd75-6742-4ce5-96a1-1030b1d2f7eb tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:25.247140 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-0b318ab6-43a6-4e4c-984a-840c56f5f224 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:25.257186 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-0b318ab6-43a6-4e4c-984a-840c56f5f224 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1322 microversion: 2.1 time: 0.225182 Aug 06 14:30:25.267269 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 26/71] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:25 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1322 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:30:25.339922 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-1464bd75-6742-4ce5-96a1-1030b1d2f7eb tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:25.348387 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-1464bd75-6742-4ce5-96a1-1030b1d2f7eb tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:25.349898 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-1464bd75-6742-4ce5-96a1-1030b1d2f7eb tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:25.351031 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-1464bd75-6742-4ce5-96a1-1030b1d2f7eb tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1286 microversion: 2.20 time: 0.149726 Aug 06 14:30:25.352257 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 46/72] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:30:25 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1286 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 14:30:25.536499 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-650bdfbf-42d2-443d-9389-76dd8ac18cec tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:25.537496 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-650bdfbf-42d2-443d-9389-76dd8ac18cec tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6e717f01-c854-444e-9872-51e2c1c78987] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:25.559098 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-650bdfbf-42d2-443d-9389-76dd8ac18cec tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:25.559637 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-650bdfbf-42d2-443d-9389-76dd8ac18cec tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:25.560086 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-650bdfbf-42d2-443d-9389-76dd8ac18cec tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:25.563416 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-650bdfbf-42d2-443d-9389-76dd8ac18cec tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:25.565064 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-650bdfbf-42d2-443d-9389-76dd8ac18cec tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:25.565525 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-650bdfbf-42d2-443d-9389-76dd8ac18cec tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:25.735931 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-650bdfbf-42d2-443d-9389-76dd8ac18cec tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:25.764844 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-650bdfbf-42d2-443d-9389-76dd8ac18cec tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987" status: 200 len: 1245 microversion: 2.1 time: 0.234840 Aug 06 14:30:25.766962 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 27/73] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:25 2022] GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987 => generated 1245 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:25.855133 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-9a7cc4fa-eb8e-480c-b0f7-4320d3ae6bb5 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:25.856841 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-9a7cc4fa-eb8e-480c-b0f7-4320d3ae6bb5 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:25.869973 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9a7cc4fa-eb8e-480c-b0f7-4320d3ae6bb5 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:25.877224 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9a7cc4fa-eb8e-480c-b0f7-4320d3ae6bb5 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:25.877622 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9a7cc4fa-eb8e-480c-b0f7-4320d3ae6bb5 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:25.878359 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9a7cc4fa-eb8e-480c-b0f7-4320d3ae6bb5 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:25.878807 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9a7cc4fa-eb8e-480c-b0f7-4320d3ae6bb5 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:25.879266 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9a7cc4fa-eb8e-480c-b0f7-4320d3ae6bb5 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:26.058135 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-32e671a6-db40-4118-95ef-51c8d4b81750 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:26.059447 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-32e671a6-db40-4118-95ef-51c8d4b81750 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] [instance: 0604e338-9ab8-40db-a076-0fb13ba92f24] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:26.069347 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-32e671a6-db40-4118-95ef-51c8d4b81750 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:26.071230 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-32e671a6-db40-4118-95ef-51c8d4b81750 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:26.072267 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-32e671a6-db40-4118-95ef-51c8d4b81750 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:26.073181 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-32e671a6-db40-4118-95ef-51c8d4b81750 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:26.073820 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-32e671a6-db40-4118-95ef-51c8d4b81750 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:26.074456 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-32e671a6-db40-4118-95ef-51c8d4b81750 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:26.082134 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-9a7cc4fa-eb8e-480c-b0f7-4320d3ae6bb5 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:26.105964 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-9a7cc4fa-eb8e-480c-b0f7-4320d3ae6bb5 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1241 microversion: 2.1 time: 0.257850 Aug 06 14:30:26.111983 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 47/74] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:25 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1241 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:26.186725 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-32e671a6-db40-4118-95ef-51c8d4b81750 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1e8506e8b34a8d9c59b4acdbf23bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ead8c81ff3486683d21f671acac6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:26.199251 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-32e671a6-db40-4118-95ef-51c8d4b81750 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] 10.222.0.17 "GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24" status: 200 len: 1266 microversion: 2.1 time: 0.145403 Aug 06 14:30:26.201796 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 28/75] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:26 2022] GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:26.281131 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-6c63d408-483a-449a-9415-0c8240ceb234 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:26.282100 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-6c63d408-483a-449a-9415-0c8240ceb234 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:26.294225 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6c63d408-483a-449a-9415-0c8240ceb234 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:26.296378 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6c63d408-483a-449a-9415-0c8240ceb234 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:26.297312 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6c63d408-483a-449a-9415-0c8240ceb234 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:26.298244 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6c63d408-483a-449a-9415-0c8240ceb234 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:26.300138 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6c63d408-483a-449a-9415-0c8240ceb234 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:26.301266 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6c63d408-483a-449a-9415-0c8240ceb234 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:26.380388 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-6daca32c-7e5a-4e26-8664-366ff54f8f51 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:26.381191 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-6daca32c-7e5a-4e26-8664-366ff54f8f51 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:26.403267 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6daca32c-7e5a-4e26-8664-366ff54f8f51 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:26.404934 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6daca32c-7e5a-4e26-8664-366ff54f8f51 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:26.413310 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6daca32c-7e5a-4e26-8664-366ff54f8f51 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:26.415264 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6daca32c-7e5a-4e26-8664-366ff54f8f51 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:26.420085 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6daca32c-7e5a-4e26-8664-366ff54f8f51 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:26.421326 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6daca32c-7e5a-4e26-8664-366ff54f8f51 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:26.551906 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-6daca32c-7e5a-4e26-8664-366ff54f8f51 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:26.569230 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-6daca32c-7e5a-4e26-8664-366ff54f8f51 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:26.571515 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-6daca32c-7e5a-4e26-8664-366ff54f8f51 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:26.572754 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-6daca32c-7e5a-4e26-8664-366ff54f8f51 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1334 microversion: 2.20 time: 0.202697 Aug 06 14:30:26.573319 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 29/76] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:30:26 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1334 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 14:30:26.789835 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-04d8a6ea-8c82-4fad-bbd2-3fcffa2d4e51 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:26.790616 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-04d8a6ea-8c82-4fad-bbd2-3fcffa2d4e51 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6e717f01-c854-444e-9872-51e2c1c78987] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:26.801827 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-04d8a6ea-8c82-4fad-bbd2-3fcffa2d4e51 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:26.803975 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-04d8a6ea-8c82-4fad-bbd2-3fcffa2d4e51 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:26.806511 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-04d8a6ea-8c82-4fad-bbd2-3fcffa2d4e51 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:26.809206 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-04d8a6ea-8c82-4fad-bbd2-3fcffa2d4e51 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:26.810000 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-04d8a6ea-8c82-4fad-bbd2-3fcffa2d4e51 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:26.810765 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-04d8a6ea-8c82-4fad-bbd2-3fcffa2d4e51 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:26.823342 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-6c63d408-483a-449a-9415-0c8240ceb234 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:26.833589 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-6c63d408-483a-449a-9415-0c8240ceb234 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1322 microversion: 2.1 time: 0.556729 Aug 06 14:30:26.834197 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 48/77] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:26 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1322 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:26.896066 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-04d8a6ea-8c82-4fad-bbd2-3fcffa2d4e51 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:26.903672 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-04d8a6ea-8c82-4fad-bbd2-3fcffa2d4e51 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987" status: 200 len: 1293 microversion: 2.1 time: 0.118428 Aug 06 14:30:26.904247 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 30/78] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:26 2022] GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987 => generated 1293 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:27.126758 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-c1b117f9-6401-4b2c-a466-67f9e2d9c209 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:27.127825 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-c1b117f9-6401-4b2c-a466-67f9e2d9c209 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:27.136479 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c1b117f9-6401-4b2c-a466-67f9e2d9c209 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:27.137611 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c1b117f9-6401-4b2c-a466-67f9e2d9c209 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:27.138104 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c1b117f9-6401-4b2c-a466-67f9e2d9c209 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:27.138727 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c1b117f9-6401-4b2c-a466-67f9e2d9c209 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:27.139357 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c1b117f9-6401-4b2c-a466-67f9e2d9c209 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:27.139775 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c1b117f9-6401-4b2c-a466-67f9e2d9c209 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:27.204421 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-c1b117f9-6401-4b2c-a466-67f9e2d9c209 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:27.212418 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-c1b117f9-6401-4b2c-a466-67f9e2d9c209 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1289 microversion: 2.1 time: 0.090332 Aug 06 14:30:27.232871 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-7ae6900b-dc6f-4dfa-9093-105eb73e35fb tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:27.234468 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-7ae6900b-dc6f-4dfa-9093-105eb73e35fb tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] [instance: 0604e338-9ab8-40db-a076-0fb13ba92f24] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:27.239034 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 49/79] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:27 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1289 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:27.248977 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7ae6900b-dc6f-4dfa-9093-105eb73e35fb tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:27.250126 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7ae6900b-dc6f-4dfa-9093-105eb73e35fb tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:27.250967 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7ae6900b-dc6f-4dfa-9093-105eb73e35fb tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:27.251975 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7ae6900b-dc6f-4dfa-9093-105eb73e35fb tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:27.252638 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7ae6900b-dc6f-4dfa-9093-105eb73e35fb tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:27.253975 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7ae6900b-dc6f-4dfa-9093-105eb73e35fb tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:27.326671 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-7ae6900b-dc6f-4dfa-9093-105eb73e35fb tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1e8506e8b34a8d9c59b4acdbf23bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ead8c81ff3486683d21f671acac6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:27.337777 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-7ae6900b-dc6f-4dfa-9093-105eb73e35fb tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] 10.222.0.17 "GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24" status: 200 len: 1274 microversion: 2.1 time: 0.118053 Aug 06 14:30:27.339097 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 31/80] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:27 2022] GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24 => generated 1274 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:30:27.597641 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-d4958319-740d-4f6e-9d5d-cabc76254161 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:27.598347 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-d4958319-740d-4f6e-9d5d-cabc76254161 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:27.604364 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d4958319-740d-4f6e-9d5d-cabc76254161 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:27.604930 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d4958319-740d-4f6e-9d5d-cabc76254161 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:27.605474 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d4958319-740d-4f6e-9d5d-cabc76254161 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:27.606236 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d4958319-740d-4f6e-9d5d-cabc76254161 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:27.606700 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d4958319-740d-4f6e-9d5d-cabc76254161 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:27.607214 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d4958319-740d-4f6e-9d5d-cabc76254161 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:27.672167 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-d4958319-740d-4f6e-9d5d-cabc76254161 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:27.675557 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_cell1:SELECT=100 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:30:27.680733 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-d4958319-740d-4f6e-9d5d-cabc76254161 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:27.682239 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-d4958319-740d-4f6e-9d5d-cabc76254161 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:27.683376 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-d4958319-740d-4f6e-9d5d-cabc76254161 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1334 microversion: 2.20 time: 0.089589 Aug 06 14:30:27.683929 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 50/81] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:30:27 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1334 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:30:27.853597 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-f3919b7d-363b-4906-abfb-df3ad4e45f1c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:27.854203 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-f3919b7d-363b-4906-abfb-df3ad4e45f1c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:27.860482 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f3919b7d-363b-4906-abfb-df3ad4e45f1c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:27.860960 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f3919b7d-363b-4906-abfb-df3ad4e45f1c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:27.861386 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f3919b7d-363b-4906-abfb-df3ad4e45f1c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:27.862191 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f3919b7d-363b-4906-abfb-df3ad4e45f1c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:27.862644 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f3919b7d-363b-4906-abfb-df3ad4e45f1c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:27.863100 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f3919b7d-363b-4906-abfb-df3ad4e45f1c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:27.926134 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-f762b9e6-a821-4325-a061-158bd6c601d3 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:27.927712 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-f762b9e6-a821-4325-a061-158bd6c601d3 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6e717f01-c854-444e-9872-51e2c1c78987] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:27.935730 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f762b9e6-a821-4325-a061-158bd6c601d3 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:27.936437 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f762b9e6-a821-4325-a061-158bd6c601d3 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:27.936633 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f762b9e6-a821-4325-a061-158bd6c601d3 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:27.937666 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f762b9e6-a821-4325-a061-158bd6c601d3 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:27.938276 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f762b9e6-a821-4325-a061-158bd6c601d3 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:27.938704 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f762b9e6-a821-4325-a061-158bd6c601d3 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:28.015532 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-f762b9e6-a821-4325-a061-158bd6c601d3 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:28.025419 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-f762b9e6-a821-4325-a061-158bd6c601d3 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987" status: 200 len: 1293 microversion: 2.1 time: 0.103560 Aug 06 14:30:28.044180 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 51/82] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:27 2022] GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987 => generated 1293 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:28.070875 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-f3919b7d-363b-4906-abfb-df3ad4e45f1c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:28.079187 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-f3919b7d-363b-4906-abfb-df3ad4e45f1c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1322 microversion: 2.1 time: 0.229283 Aug 06 14:30:28.080389 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 32/83] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:27 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1322 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:28.237502 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-eebcda8d-7761-4e96-bfb9-1186801fc6c2 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:28.238188 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-eebcda8d-7761-4e96-bfb9-1186801fc6c2 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:28.244759 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-eebcda8d-7761-4e96-bfb9-1186801fc6c2 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:28.245271 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-eebcda8d-7761-4e96-bfb9-1186801fc6c2 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:28.245707 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-eebcda8d-7761-4e96-bfb9-1186801fc6c2 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:28.246396 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-eebcda8d-7761-4e96-bfb9-1186801fc6c2 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:28.246903 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-eebcda8d-7761-4e96-bfb9-1186801fc6c2 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:28.247403 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-eebcda8d-7761-4e96-bfb9-1186801fc6c2 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:28.309456 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-eebcda8d-7761-4e96-bfb9-1186801fc6c2 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:28.317371 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-eebcda8d-7761-4e96-bfb9-1186801fc6c2 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1289 microversion: 2.1 time: 0.084730 Aug 06 14:30:28.317938 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 52/84] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:28 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1289 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:30:28.363517 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-1428c4f1-bc75-409e-aa31-1c3ae70dc902 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:28.363517 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-1428c4f1-bc75-409e-aa31-1c3ae70dc902 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] [instance: 0604e338-9ab8-40db-a076-0fb13ba92f24] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:28.368786 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1428c4f1-bc75-409e-aa31-1c3ae70dc902 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:28.369341 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1428c4f1-bc75-409e-aa31-1c3ae70dc902 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:28.369837 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1428c4f1-bc75-409e-aa31-1c3ae70dc902 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:28.370593 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1428c4f1-bc75-409e-aa31-1c3ae70dc902 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:28.371139 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1428c4f1-bc75-409e-aa31-1c3ae70dc902 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:28.371621 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1428c4f1-bc75-409e-aa31-1c3ae70dc902 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:28.438842 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-1428c4f1-bc75-409e-aa31-1c3ae70dc902 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1e8506e8b34a8d9c59b4acdbf23bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ead8c81ff3486683d21f671acac6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:28.446182 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-1428c4f1-bc75-409e-aa31-1c3ae70dc902 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] 10.222.0.17 "GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24" status: 200 len: 1274 microversion: 2.1 time: 0.089658 Aug 06 14:30:28.446739 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 33/85] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:28 2022] GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24 => generated 1274 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:28.710073 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-f2520d75-9f83-4f20-93f0-1e9e34240ceb tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:28.711413 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-f2520d75-9f83-4f20-93f0-1e9e34240ceb tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:28.720623 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f2520d75-9f83-4f20-93f0-1e9e34240ceb tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:28.721147 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f2520d75-9f83-4f20-93f0-1e9e34240ceb tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:28.721970 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f2520d75-9f83-4f20-93f0-1e9e34240ceb tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:28.722707 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f2520d75-9f83-4f20-93f0-1e9e34240ceb tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:28.723241 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f2520d75-9f83-4f20-93f0-1e9e34240ceb tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:28.723850 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f2520d75-9f83-4f20-93f0-1e9e34240ceb tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:28.792936 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-f2520d75-9f83-4f20-93f0-1e9e34240ceb tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:28.801137 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-f2520d75-9f83-4f20-93f0-1e9e34240ceb tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:28.802662 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-f2520d75-9f83-4f20-93f0-1e9e34240ceb tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:28.803972 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-f2520d75-9f83-4f20-93f0-1e9e34240ceb tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1334 microversion: 2.20 time: 0.099071 Aug 06 14:30:28.804601 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 53/86] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:30:28 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1334 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:30:29.058611 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-30f22b2b-aa24-44ce-9e5f-3404aa02ae6b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:29.059218 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-30f22b2b-aa24-44ce-9e5f-3404aa02ae6b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6e717f01-c854-444e-9872-51e2c1c78987] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:29.065094 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-30f22b2b-aa24-44ce-9e5f-3404aa02ae6b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:29.065568 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-30f22b2b-aa24-44ce-9e5f-3404aa02ae6b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:29.066001 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-30f22b2b-aa24-44ce-9e5f-3404aa02ae6b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:29.066680 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-30f22b2b-aa24-44ce-9e5f-3404aa02ae6b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:29.067153 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-30f22b2b-aa24-44ce-9e5f-3404aa02ae6b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:29.067572 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-30f22b2b-aa24-44ce-9e5f-3404aa02ae6b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:29.100362 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-8df79775-becc-4c16-bf76-dbf777473a21 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:29.100968 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-8df79775-becc-4c16-bf76-dbf777473a21 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:29.107377 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8df79775-becc-4c16-bf76-dbf777473a21 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:29.107805 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8df79775-becc-4c16-bf76-dbf777473a21 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:29.108232 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8df79775-becc-4c16-bf76-dbf777473a21 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:29.109249 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8df79775-becc-4c16-bf76-dbf777473a21 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:29.109866 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8df79775-becc-4c16-bf76-dbf777473a21 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:29.110443 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8df79775-becc-4c16-bf76-dbf777473a21 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:29.132762 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-30f22b2b-aa24-44ce-9e5f-3404aa02ae6b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:29.140174 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-30f22b2b-aa24-44ce-9e5f-3404aa02ae6b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987" status: 200 len: 1293 microversion: 2.1 time: 0.088115 Aug 06 14:30:29.141100 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 34/87] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:29 2022] GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987 => generated 1293 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:29.251593 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-8df79775-becc-4c16-bf76-dbf777473a21 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:29.261728 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-8df79775-becc-4c16-bf76-dbf777473a21 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1322 microversion: 2.1 time: 0.165384 Aug 06 14:30:29.262716 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 54/88] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:29 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:29.337636 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-287daf6d-30f1-4016-bdf3-88a9691b6182 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:29.338177 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-287daf6d-30f1-4016-bdf3-88a9691b6182 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:29.344044 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-287daf6d-30f1-4016-bdf3-88a9691b6182 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:29.344525 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-287daf6d-30f1-4016-bdf3-88a9691b6182 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:29.344958 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-287daf6d-30f1-4016-bdf3-88a9691b6182 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:29.345662 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-287daf6d-30f1-4016-bdf3-88a9691b6182 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:29.346114 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-287daf6d-30f1-4016-bdf3-88a9691b6182 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:29.346533 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-287daf6d-30f1-4016-bdf3-88a9691b6182 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:29.409264 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-287daf6d-30f1-4016-bdf3-88a9691b6182 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:29.416589 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-287daf6d-30f1-4016-bdf3-88a9691b6182 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1289 microversion: 2.1 time: 0.082878 Aug 06 14:30:29.417148 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 35/89] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:29 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1289 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:29.466453 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-7407438b-df94-44fa-9bb4-a1909109d99d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:29.467099 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-7407438b-df94-44fa-9bb4-a1909109d99d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] [instance: 0604e338-9ab8-40db-a076-0fb13ba92f24] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:29.472974 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7407438b-df94-44fa-9bb4-a1909109d99d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:29.473483 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7407438b-df94-44fa-9bb4-a1909109d99d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:29.473923 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7407438b-df94-44fa-9bb4-a1909109d99d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:29.474613 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7407438b-df94-44fa-9bb4-a1909109d99d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:29.475103 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7407438b-df94-44fa-9bb4-a1909109d99d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:29.475536 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7407438b-df94-44fa-9bb4-a1909109d99d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:29.538339 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-7407438b-df94-44fa-9bb4-a1909109d99d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1e8506e8b34a8d9c59b4acdbf23bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ead8c81ff3486683d21f671acac6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:29.545837 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-7407438b-df94-44fa-9bb4-a1909109d99d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] 10.222.0.17 "GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24" status: 200 len: 1274 microversion: 2.1 time: 0.083212 Aug 06 14:30:29.546566 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 55/90] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:29 2022] GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24 => generated 1274 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:29.829645 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-8978d41a-692f-4e83-9c44-df272c180f1a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:29.830252 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-8978d41a-692f-4e83-9c44-df272c180f1a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:29.836345 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8978d41a-692f-4e83-9c44-df272c180f1a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:29.836832 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8978d41a-692f-4e83-9c44-df272c180f1a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:29.837267 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8978d41a-692f-4e83-9c44-df272c180f1a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:29.837993 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8978d41a-692f-4e83-9c44-df272c180f1a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:29.838449 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8978d41a-692f-4e83-9c44-df272c180f1a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:29.838885 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8978d41a-692f-4e83-9c44-df272c180f1a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:29.903688 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-8978d41a-692f-4e83-9c44-df272c180f1a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:29.915481 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-8978d41a-692f-4e83-9c44-df272c180f1a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:29.917031 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-8978d41a-692f-4e83-9c44-df272c180f1a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:29.918236 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-8978d41a-692f-4e83-9c44-df272c180f1a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1334 microversion: 2.20 time: 0.092515 Aug 06 14:30:29.918809 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 36/91] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:30:29 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1334 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:30:30.161106 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-7765da7a-7591-47c3-a4b5-5551442d447a tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:30.161642 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-7765da7a-7591-47c3-a4b5-5551442d447a tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6e717f01-c854-444e-9872-51e2c1c78987] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:30.168415 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7765da7a-7591-47c3-a4b5-5551442d447a tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:30.168927 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7765da7a-7591-47c3-a4b5-5551442d447a tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:30.169362 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7765da7a-7591-47c3-a4b5-5551442d447a tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:30.170053 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7765da7a-7591-47c3-a4b5-5551442d447a tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:30.170507 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7765da7a-7591-47c3-a4b5-5551442d447a tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:30.170977 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7765da7a-7591-47c3-a4b5-5551442d447a tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:30.232588 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-7765da7a-7591-47c3-a4b5-5551442d447a tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:30.240020 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-7765da7a-7591-47c3-a4b5-5551442d447a tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987" status: 200 len: 1293 microversion: 2.1 time: 0.082847 Aug 06 14:30:30.240574 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 56/92] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:30 2022] GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987 => generated 1293 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:30:30.282637 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-ab21640e-8af7-4df4-9fe2-d98e7acda2cf tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:30.283289 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-ab21640e-8af7-4df4-9fe2-d98e7acda2cf tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:30.289633 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ab21640e-8af7-4df4-9fe2-d98e7acda2cf tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:30.290115 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ab21640e-8af7-4df4-9fe2-d98e7acda2cf tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:30.290549 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ab21640e-8af7-4df4-9fe2-d98e7acda2cf tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:30.291463 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ab21640e-8af7-4df4-9fe2-d98e7acda2cf tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:30.291702 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ab21640e-8af7-4df4-9fe2-d98e7acda2cf tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:30.292124 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ab21640e-8af7-4df4-9fe2-d98e7acda2cf tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:30.422191 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-ab21640e-8af7-4df4-9fe2-d98e7acda2cf tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:30.429540 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-ab21640e-8af7-4df4-9fe2-d98e7acda2cf tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1322 microversion: 2.1 time: 0.150610 Aug 06 14:30:30.430346 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 37/93] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:30 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:30.437262 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-b62ca252-a9e3-4312-81af-514ce7d59e02 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:30.437868 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-b62ca252-a9e3-4312-81af-514ce7d59e02 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:30.444095 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b62ca252-a9e3-4312-81af-514ce7d59e02 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:30.444661 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b62ca252-a9e3-4312-81af-514ce7d59e02 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:30.445592 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b62ca252-a9e3-4312-81af-514ce7d59e02 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:30.446284 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b62ca252-a9e3-4312-81af-514ce7d59e02 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:30.446739 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b62ca252-a9e3-4312-81af-514ce7d59e02 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:30.447200 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b62ca252-a9e3-4312-81af-514ce7d59e02 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:30.506306 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-b62ca252-a9e3-4312-81af-514ce7d59e02 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:30.514025 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-b62ca252-a9e3-4312-81af-514ce7d59e02 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1289 microversion: 2.1 time: 0.080499 Aug 06 14:30:30.514584 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 57/94] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:30 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1289 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:30.567380 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-3cef5144-4172-4daa-8a63-da1fd6536cb2 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:30.567990 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-3cef5144-4172-4daa-8a63-da1fd6536cb2 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] [instance: 0604e338-9ab8-40db-a076-0fb13ba92f24] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:30.574332 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3cef5144-4172-4daa-8a63-da1fd6536cb2 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:30.574813 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3cef5144-4172-4daa-8a63-da1fd6536cb2 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:30.575274 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3cef5144-4172-4daa-8a63-da1fd6536cb2 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:30.575953 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3cef5144-4172-4daa-8a63-da1fd6536cb2 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:30.576402 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3cef5144-4172-4daa-8a63-da1fd6536cb2 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:30.576825 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3cef5144-4172-4daa-8a63-da1fd6536cb2 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:30.637203 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-3cef5144-4172-4daa-8a63-da1fd6536cb2 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1e8506e8b34a8d9c59b4acdbf23bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ead8c81ff3486683d21f671acac6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:30.644553 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-3cef5144-4172-4daa-8a63-da1fd6536cb2 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] 10.222.0.17 "GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24" status: 200 len: 1274 microversion: 2.1 time: 0.081020 Aug 06 14:30:30.645109 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 38/95] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:30 2022] GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24 => generated 1274 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:30.941538 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-71057577-f039-4f3a-881c-298e4757a213 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:30.942136 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-71057577-f039-4f3a-881c-298e4757a213 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:30.948632 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-71057577-f039-4f3a-881c-298e4757a213 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:30.949107 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-71057577-f039-4f3a-881c-298e4757a213 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:30.949531 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-71057577-f039-4f3a-881c-298e4757a213 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:30.950209 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-71057577-f039-4f3a-881c-298e4757a213 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:30.950653 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-71057577-f039-4f3a-881c-298e4757a213 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:30.951098 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-71057577-f039-4f3a-881c-298e4757a213 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:31.010124 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-71057577-f039-4f3a-881c-298e4757a213 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:31.018097 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-71057577-f039-4f3a-881c-298e4757a213 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:31.019689 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-71057577-f039-4f3a-881c-298e4757a213 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:31.020784 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-71057577-f039-4f3a-881c-298e4757a213 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1334 microversion: 2.20 time: 0.083194 Aug 06 14:30:31.021399 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 58/96] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:30:30 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1334 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:30:31.259988 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-1f87dec3-0b6e-42d2-a3c9-1925c8f0aa9f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:31.260625 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-1f87dec3-0b6e-42d2-a3c9-1925c8f0aa9f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6e717f01-c854-444e-9872-51e2c1c78987] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:31.266469 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1f87dec3-0b6e-42d2-a3c9-1925c8f0aa9f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:31.266974 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1f87dec3-0b6e-42d2-a3c9-1925c8f0aa9f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:31.267407 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1f87dec3-0b6e-42d2-a3c9-1925c8f0aa9f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:31.268091 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1f87dec3-0b6e-42d2-a3c9-1925c8f0aa9f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:31.268540 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1f87dec3-0b6e-42d2-a3c9-1925c8f0aa9f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:31.268961 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1f87dec3-0b6e-42d2-a3c9-1925c8f0aa9f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:31.335134 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-1f87dec3-0b6e-42d2-a3c9-1925c8f0aa9f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:31.341874 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_cell1:SELECT=100 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:30:31.344115 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-1f87dec3-0b6e-42d2-a3c9-1925c8f0aa9f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987" status: 200 len: 1293 microversion: 2.1 time: 0.087918 Aug 06 14:30:31.352691 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 39/97] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:31 2022] GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987 => generated 1293 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:31.449506 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-03ad69c6-5590-4a22-bdcb-f96af9beb642 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:31.450125 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-03ad69c6-5590-4a22-bdcb-f96af9beb642 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:31.455986 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-03ad69c6-5590-4a22-bdcb-f96af9beb642 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:31.456472 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-03ad69c6-5590-4a22-bdcb-f96af9beb642 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:31.456905 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-03ad69c6-5590-4a22-bdcb-f96af9beb642 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:31.457598 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-03ad69c6-5590-4a22-bdcb-f96af9beb642 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:31.458055 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-03ad69c6-5590-4a22-bdcb-f96af9beb642 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:31.458485 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-03ad69c6-5590-4a22-bdcb-f96af9beb642 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:31.534705 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-fc2600a7-6e93-4416-8cb3-d10208628c60 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:31.535375 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-fc2600a7-6e93-4416-8cb3-d10208628c60 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:31.543605 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-fc2600a7-6e93-4416-8cb3-d10208628c60 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:31.544394 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-fc2600a7-6e93-4416-8cb3-d10208628c60 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:31.544893 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-fc2600a7-6e93-4416-8cb3-d10208628c60 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:31.545770 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-fc2600a7-6e93-4416-8cb3-d10208628c60 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:31.546392 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-fc2600a7-6e93-4416-8cb3-d10208628c60 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:31.546824 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-fc2600a7-6e93-4416-8cb3-d10208628c60 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:31.595814 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-03ad69c6-5590-4a22-bdcb-f96af9beb642 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:31.603972 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-03ad69c6-5590-4a22-bdcb-f96af9beb642 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1322 microversion: 2.1 time: 0.158299 Aug 06 14:30:31.604555 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 59/98] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:31 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:31.620049 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-fc2600a7-6e93-4416-8cb3-d10208628c60 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:31.627888 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-fc2600a7-6e93-4416-8cb3-d10208628c60 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1289 microversion: 2.1 time: 0.097509 Aug 06 14:30:31.628490 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 40/99] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:31 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1289 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:31.666305 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-1665c4e4-420f-4d3b-952b-dbe29507fbbf tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:31.667072 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-1665c4e4-420f-4d3b-952b-dbe29507fbbf tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] [instance: 0604e338-9ab8-40db-a076-0fb13ba92f24] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:31.674090 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1665c4e4-420f-4d3b-952b-dbe29507fbbf tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:31.674675 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1665c4e4-420f-4d3b-952b-dbe29507fbbf tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:31.675212 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1665c4e4-420f-4d3b-952b-dbe29507fbbf tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:31.676169 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1665c4e4-420f-4d3b-952b-dbe29507fbbf tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:31.676630 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1665c4e4-420f-4d3b-952b-dbe29507fbbf tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:31.677054 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1665c4e4-420f-4d3b-952b-dbe29507fbbf tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:31.746664 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-1665c4e4-420f-4d3b-952b-dbe29507fbbf tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1e8506e8b34a8d9c59b4acdbf23bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ead8c81ff3486683d21f671acac6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:31.754011 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-1665c4e4-420f-4d3b-952b-dbe29507fbbf tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] 10.222.0.17 "GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24" status: 200 len: 1274 microversion: 2.1 time: 0.092207 Aug 06 14:30:31.754573 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 60/100] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:31 2022] GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24 => generated 1274 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:30:32.045098 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-5def0155-d2d4-45a0-bf58-4c4649dd9f1d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:32.045701 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-5def0155-d2d4-45a0-bf58-4c4649dd9f1d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:32.047591 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_cell0:SELECT=4 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:30:32.053069 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5def0155-d2d4-45a0-bf58-4c4649dd9f1d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:32.053555 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5def0155-d2d4-45a0-bf58-4c4649dd9f1d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:32.053986 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5def0155-d2d4-45a0-bf58-4c4649dd9f1d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:32.054667 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5def0155-d2d4-45a0-bf58-4c4649dd9f1d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:32.055393 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5def0155-d2d4-45a0-bf58-4c4649dd9f1d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:32.055809 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5def0155-d2d4-45a0-bf58-4c4649dd9f1d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:32.114891 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-5def0155-d2d4-45a0-bf58-4c4649dd9f1d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:32.122552 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-5def0155-d2d4-45a0-bf58-4c4649dd9f1d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:32.124073 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-5def0155-d2d4-45a0-bf58-4c4649dd9f1d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:32.125148 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-5def0155-d2d4-45a0-bf58-4c4649dd9f1d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1334 microversion: 2.20 time: 0.085506 Aug 06 14:30:32.125697 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 41/101] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:30:32 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1334 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:30:32.365325 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-5cbe0257-9e9a-4415-a53d-5cad63b175b1 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:32.365942 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-5cbe0257-9e9a-4415-a53d-5cad63b175b1 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6e717f01-c854-444e-9872-51e2c1c78987] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:32.372412 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-5cbe0257-9e9a-4415-a53d-5cad63b175b1 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:32.372900 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-5cbe0257-9e9a-4415-a53d-5cad63b175b1 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:32.373339 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-5cbe0257-9e9a-4415-a53d-5cad63b175b1 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:32.374031 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-5cbe0257-9e9a-4415-a53d-5cad63b175b1 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:32.374489 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-5cbe0257-9e9a-4415-a53d-5cad63b175b1 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:32.374943 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-5cbe0257-9e9a-4415-a53d-5cad63b175b1 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:32.436507 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-5cbe0257-9e9a-4415-a53d-5cad63b175b1 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:32.444182 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-5cbe0257-9e9a-4415-a53d-5cad63b175b1 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987" status: 200 len: 1293 microversion: 2.1 time: 0.082648 Aug 06 14:30:32.445378 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 61/102] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:32 2022] GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987 => generated 1293 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:32.624662 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-020fc55c-1e73-41a6-92ec-0c1d4a66751e tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:32.625261 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-020fc55c-1e73-41a6-92ec-0c1d4a66751e tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:32.631155 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-020fc55c-1e73-41a6-92ec-0c1d4a66751e tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:32.631634 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-020fc55c-1e73-41a6-92ec-0c1d4a66751e tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:32.632062 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-020fc55c-1e73-41a6-92ec-0c1d4a66751e tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:32.633386 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-020fc55c-1e73-41a6-92ec-0c1d4a66751e tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:32.633838 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-020fc55c-1e73-41a6-92ec-0c1d4a66751e tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:32.634260 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-020fc55c-1e73-41a6-92ec-0c1d4a66751e tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:32.648539 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-e208eb47-429f-4fa4-84c8-79a23b4729f3 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:32.649153 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-e208eb47-429f-4fa4-84c8-79a23b4729f3 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:32.654967 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e208eb47-429f-4fa4-84c8-79a23b4729f3 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:32.655453 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e208eb47-429f-4fa4-84c8-79a23b4729f3 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:32.655914 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e208eb47-429f-4fa4-84c8-79a23b4729f3 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:32.656603 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e208eb47-429f-4fa4-84c8-79a23b4729f3 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:32.657057 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e208eb47-429f-4fa4-84c8-79a23b4729f3 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:32.657486 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e208eb47-429f-4fa4-84c8-79a23b4729f3 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:32.734058 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-e208eb47-429f-4fa4-84c8-79a23b4729f3 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:32.741616 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-e208eb47-429f-4fa4-84c8-79a23b4729f3 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1289 microversion: 2.1 time: 0.096831 Aug 06 14:30:32.742724 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 62/103] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:32 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1289 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:30:32.774232 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-11f5baeb-af75-478b-8963-b506b672ddab tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:32.774846 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-020fc55c-1e73-41a6-92ec-0c1d4a66751e tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:32.775012 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-11f5baeb-af75-478b-8963-b506b672ddab tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] [instance: 0604e338-9ab8-40db-a076-0fb13ba92f24] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:32.781655 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-11f5baeb-af75-478b-8963-b506b672ddab tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:32.782137 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-11f5baeb-af75-478b-8963-b506b672ddab tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:32.782571 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-11f5baeb-af75-478b-8963-b506b672ddab tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:32.783294 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-11f5baeb-af75-478b-8963-b506b672ddab tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:32.783745 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-11f5baeb-af75-478b-8963-b506b672ddab tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:32.784164 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-11f5baeb-af75-478b-8963-b506b672ddab tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:32.784614 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-020fc55c-1e73-41a6-92ec-0c1d4a66751e tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1322 microversion: 2.1 time: 0.163721 Aug 06 14:30:32.785189 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 42/104] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:32 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:32.847313 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-11f5baeb-af75-478b-8963-b506b672ddab tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1e8506e8b34a8d9c59b4acdbf23bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ead8c81ff3486683d21f671acac6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:32.857335 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-11f5baeb-af75-478b-8963-b506b672ddab tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] 10.222.0.17 "GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24" status: 200 len: 1274 microversion: 2.1 time: 0.086760 Aug 06 14:30:32.858916 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 63/105] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:32 2022] GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24 => generated 1274 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:30:33.147049 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-48427efb-a4af-4f32-9180-4aa5086d3db7 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:33.147658 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-48427efb-a4af-4f32-9180-4aa5086d3db7 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:33.154387 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-48427efb-a4af-4f32-9180-4aa5086d3db7 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:33.155181 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-48427efb-a4af-4f32-9180-4aa5086d3db7 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:33.155896 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-48427efb-a4af-4f32-9180-4aa5086d3db7 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:33.156734 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-48427efb-a4af-4f32-9180-4aa5086d3db7 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:33.157171 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-48427efb-a4af-4f32-9180-4aa5086d3db7 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:33.157593 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-48427efb-a4af-4f32-9180-4aa5086d3db7 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:33.240441 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-48427efb-a4af-4f32-9180-4aa5086d3db7 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:33.251508 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-48427efb-a4af-4f32-9180-4aa5086d3db7 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:33.253365 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-48427efb-a4af-4f32-9180-4aa5086d3db7 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:33.254657 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-48427efb-a4af-4f32-9180-4aa5086d3db7 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1334 microversion: 2.20 time: 0.111591 Aug 06 14:30:33.255409 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 43/106] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:30:33 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1334 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:30:33.465671 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-804cb5a5-d3f3-4595-9624-ac4215a3e1dd tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:33.466289 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-804cb5a5-d3f3-4595-9624-ac4215a3e1dd tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6e717f01-c854-444e-9872-51e2c1c78987] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:33.473354 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-804cb5a5-d3f3-4595-9624-ac4215a3e1dd tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:33.473852 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-804cb5a5-d3f3-4595-9624-ac4215a3e1dd tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:33.474289 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-804cb5a5-d3f3-4595-9624-ac4215a3e1dd tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:33.475097 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-804cb5a5-d3f3-4595-9624-ac4215a3e1dd tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:33.475617 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-804cb5a5-d3f3-4595-9624-ac4215a3e1dd tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:33.476058 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-804cb5a5-d3f3-4595-9624-ac4215a3e1dd tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:33.542238 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-804cb5a5-d3f3-4595-9624-ac4215a3e1dd tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:33.550288 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-804cb5a5-d3f3-4595-9624-ac4215a3e1dd tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987" status: 200 len: 1293 microversion: 2.1 time: 0.088928 Aug 06 14:30:33.551266 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 64/107] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:33 2022] GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987 => generated 1293 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:33.762976 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-6e23a0ed-c5bf-4074-a2b1-203f5ebc4a5f tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:33.763596 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-6e23a0ed-c5bf-4074-a2b1-203f5ebc4a5f tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:33.770190 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6e23a0ed-c5bf-4074-a2b1-203f5ebc4a5f tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:33.770935 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6e23a0ed-c5bf-4074-a2b1-203f5ebc4a5f tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:33.771221 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6e23a0ed-c5bf-4074-a2b1-203f5ebc4a5f tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:33.771933 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6e23a0ed-c5bf-4074-a2b1-203f5ebc4a5f tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:33.772390 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6e23a0ed-c5bf-4074-a2b1-203f5ebc4a5f tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:33.772822 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6e23a0ed-c5bf-4074-a2b1-203f5ebc4a5f tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:33.806287 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-eabbf7ad-280c-4693-b06d-8f081576fd98 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:33.806984 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-eabbf7ad-280c-4693-b06d-8f081576fd98 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:33.813414 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-eabbf7ad-280c-4693-b06d-8f081576fd98 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:33.813940 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-eabbf7ad-280c-4693-b06d-8f081576fd98 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:33.814379 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-eabbf7ad-280c-4693-b06d-8f081576fd98 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:33.815145 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-eabbf7ad-280c-4693-b06d-8f081576fd98 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:33.815609 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-eabbf7ad-280c-4693-b06d-8f081576fd98 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:33.816064 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-eabbf7ad-280c-4693-b06d-8f081576fd98 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:33.855649 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-6e23a0ed-c5bf-4074-a2b1-203f5ebc4a5f tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:33.870406 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-6e23a0ed-c5bf-4074-a2b1-203f5ebc4a5f tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1289 microversion: 2.1 time: 0.108108 Aug 06 14:30:33.871676 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 44/108] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:33 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1289 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:33.877770 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-378a45e7-6b83-4c25-a75b-19eeeb3ef424 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:33.878805 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-378a45e7-6b83-4c25-a75b-19eeeb3ef424 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] [instance: 0604e338-9ab8-40db-a076-0fb13ba92f24] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:33.888835 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-378a45e7-6b83-4c25-a75b-19eeeb3ef424 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:33.889336 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-378a45e7-6b83-4c25-a75b-19eeeb3ef424 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:33.889767 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-378a45e7-6b83-4c25-a75b-19eeeb3ef424 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:33.890649 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-378a45e7-6b83-4c25-a75b-19eeeb3ef424 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:33.891132 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-378a45e7-6b83-4c25-a75b-19eeeb3ef424 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:33.891559 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-378a45e7-6b83-4c25-a75b-19eeeb3ef424 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:33.964277 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-378a45e7-6b83-4c25-a75b-19eeeb3ef424 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1e8506e8b34a8d9c59b4acdbf23bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ead8c81ff3486683d21f671acac6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:33.976053 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-378a45e7-6b83-4c25-a75b-19eeeb3ef424 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] 10.222.0.17 "GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24" status: 200 len: 1274 microversion: 2.1 time: 0.101539 Aug 06 14:30:33.976988 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 45/109] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:33 2022] GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24 => generated 1274 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:33.986319 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-eabbf7ad-280c-4693-b06d-8f081576fd98 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:33.996751 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-eabbf7ad-280c-4693-b06d-8f081576fd98 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1322 microversion: 2.1 time: 0.194962 Aug 06 14:30:33.997824 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 65/110] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:33 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1322 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:30:34.277294 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-27c4ca4b-72b2-4eec-a7ce-e02b4ba25bf3 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:34.278562 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-27c4ca4b-72b2-4eec-a7ce-e02b4ba25bf3 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:34.282182 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:30:34.286455 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-27c4ca4b-72b2-4eec-a7ce-e02b4ba25bf3 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:34.287088 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-27c4ca4b-72b2-4eec-a7ce-e02b4ba25bf3 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:34.287522 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-27c4ca4b-72b2-4eec-a7ce-e02b4ba25bf3 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:34.288367 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-27c4ca4b-72b2-4eec-a7ce-e02b4ba25bf3 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:34.288816 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-27c4ca4b-72b2-4eec-a7ce-e02b4ba25bf3 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:34.290613 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-27c4ca4b-72b2-4eec-a7ce-e02b4ba25bf3 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:34.386133 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-27c4ca4b-72b2-4eec-a7ce-e02b4ba25bf3 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:34.394889 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-27c4ca4b-72b2-4eec-a7ce-e02b4ba25bf3 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:34.396614 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-27c4ca4b-72b2-4eec-a7ce-e02b4ba25bf3 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:34.397843 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-27c4ca4b-72b2-4eec-a7ce-e02b4ba25bf3 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1334 microversion: 2.20 time: 0.124661 Aug 06 14:30:34.399804 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 46/111] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:30:34 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1334 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:30:34.573209 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-bc6e4da3-a27d-4842-8763-cdb3e50f31e3 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:34.574008 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-bc6e4da3-a27d-4842-8763-cdb3e50f31e3 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6e717f01-c854-444e-9872-51e2c1c78987] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:34.582902 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-bc6e4da3-a27d-4842-8763-cdb3e50f31e3 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:34.583398 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-bc6e4da3-a27d-4842-8763-cdb3e50f31e3 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:34.583830 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-bc6e4da3-a27d-4842-8763-cdb3e50f31e3 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:34.584536 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-bc6e4da3-a27d-4842-8763-cdb3e50f31e3 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:34.585084 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-bc6e4da3-a27d-4842-8763-cdb3e50f31e3 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:34.585540 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-bc6e4da3-a27d-4842-8763-cdb3e50f31e3 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:34.650071 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_cell0:SELECT=6 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:30:34.653708 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-bc6e4da3-a27d-4842-8763-cdb3e50f31e3 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:34.662162 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-bc6e4da3-a27d-4842-8763-cdb3e50f31e3 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987" status: 200 len: 1293 microversion: 2.1 time: 0.094649 Aug 06 14:30:34.662740 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 66/112] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:34 2022] GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987 => generated 1293 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:34.893275 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-c6e2ed61-0510-42f3-8d72-bb2b49cf3df9 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:34.894308 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-c6e2ed61-0510-42f3-8d72-bb2b49cf3df9 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:34.896477 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_cell0:SELECT=16 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:30:34.905383 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c6e2ed61-0510-42f3-8d72-bb2b49cf3df9 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:34.905876 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c6e2ed61-0510-42f3-8d72-bb2b49cf3df9 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:34.906310 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c6e2ed61-0510-42f3-8d72-bb2b49cf3df9 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:34.907045 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c6e2ed61-0510-42f3-8d72-bb2b49cf3df9 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:34.907503 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c6e2ed61-0510-42f3-8d72-bb2b49cf3df9 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:34.907921 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c6e2ed61-0510-42f3-8d72-bb2b49cf3df9 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:34.972605 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-c6e2ed61-0510-42f3-8d72-bb2b49cf3df9 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:34.980314 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-c6e2ed61-0510-42f3-8d72-bb2b49cf3df9 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1289 microversion: 2.1 time: 0.091080 Aug 06 14:30:34.980880 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 47/113] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:34 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1289 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:34.997516 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-e62f865c-d08b-4859-89b2-505c9ea610df tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:34.998217 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-e62f865c-d08b-4859-89b2-505c9ea610df tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] [instance: 0604e338-9ab8-40db-a076-0fb13ba92f24] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:35.000223 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_cell0:SELECT=18 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:30:35.006691 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e62f865c-d08b-4859-89b2-505c9ea610df tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:35.007321 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e62f865c-d08b-4859-89b2-505c9ea610df tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:35.007826 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e62f865c-d08b-4859-89b2-505c9ea610df tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:35.009013 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e62f865c-d08b-4859-89b2-505c9ea610df tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:35.009468 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e62f865c-d08b-4859-89b2-505c9ea610df tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:35.009891 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e62f865c-d08b-4859-89b2-505c9ea610df tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:35.021448 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-211f16f8-61cd-45a2-b306-5bddbf75f7eb tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:35.022058 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-211f16f8-61cd-45a2-b306-5bddbf75f7eb tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:35.030818 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-211f16f8-61cd-45a2-b306-5bddbf75f7eb tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:35.031834 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-211f16f8-61cd-45a2-b306-5bddbf75f7eb tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:35.031980 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_cell1:SELECT=100 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:30:35.032615 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-211f16f8-61cd-45a2-b306-5bddbf75f7eb tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:35.033923 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-211f16f8-61cd-45a2-b306-5bddbf75f7eb tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:35.034755 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-211f16f8-61cd-45a2-b306-5bddbf75f7eb tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:35.035568 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-211f16f8-61cd-45a2-b306-5bddbf75f7eb tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:35.081385 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-e62f865c-d08b-4859-89b2-505c9ea610df tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1e8506e8b34a8d9c59b4acdbf23bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ead8c81ff3486683d21f671acac6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:35.091781 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-e62f865c-d08b-4859-89b2-505c9ea610df tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] 10.222.0.17 "GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24" status: 200 len: 1284 microversion: 2.1 time: 0.098016 Aug 06 14:30:35.092361 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 67/114] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:34 2022] GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24 => generated 1284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:35.179458 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-211f16f8-61cd-45a2-b306-5bddbf75f7eb tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:35.187596 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-211f16f8-61cd-45a2-b306-5bddbf75f7eb tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1322 microversion: 2.1 time: 0.172561 Aug 06 14:30:35.188794 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 48/115] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:35 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:35.421380 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-e730d54f-960d-4a26-a51e-1887a0008ac2 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:35.421990 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-e730d54f-960d-4a26-a51e-1887a0008ac2 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:35.428047 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e730d54f-960d-4a26-a51e-1887a0008ac2 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:35.428529 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e730d54f-960d-4a26-a51e-1887a0008ac2 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:35.428958 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e730d54f-960d-4a26-a51e-1887a0008ac2 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:35.429709 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e730d54f-960d-4a26-a51e-1887a0008ac2 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:35.430943 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e730d54f-960d-4a26-a51e-1887a0008ac2 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:35.431405 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e730d54f-960d-4a26-a51e-1887a0008ac2 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:35.495292 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-e730d54f-960d-4a26-a51e-1887a0008ac2 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:35.503557 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-e730d54f-960d-4a26-a51e-1887a0008ac2 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:35.505054 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-e730d54f-960d-4a26-a51e-1887a0008ac2 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:35.506163 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-e730d54f-960d-4a26-a51e-1887a0008ac2 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1334 microversion: 2.20 time: 0.088760 Aug 06 14:30:35.506715 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 68/116] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:30:35 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1334 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:30:35.683835 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-c4363221-9bc8-43b0-b635-bccc7458da8c tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:35.684515 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-c4363221-9bc8-43b0-b635-bccc7458da8c tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6e717f01-c854-444e-9872-51e2c1c78987] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:35.690490 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c4363221-9bc8-43b0-b635-bccc7458da8c tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:35.691015 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c4363221-9bc8-43b0-b635-bccc7458da8c tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:35.691504 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c4363221-9bc8-43b0-b635-bccc7458da8c tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:35.692194 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c4363221-9bc8-43b0-b635-bccc7458da8c tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:35.692640 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c4363221-9bc8-43b0-b635-bccc7458da8c tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:35.693063 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c4363221-9bc8-43b0-b635-bccc7458da8c tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:35.758218 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-c4363221-9bc8-43b0-b635-bccc7458da8c tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:35.767619 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-c4363221-9bc8-43b0-b635-bccc7458da8c tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987" status: 200 len: 1293 microversion: 2.1 time: 0.087867 Aug 06 14:30:35.768900 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 49/117] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:35 2022] GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987 => generated 1293 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:36.000186 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-96672259-62a5-4695-ba8b-bb806e79ce2d tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:36.001456 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-96672259-62a5-4695-ba8b-bb806e79ce2d tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:36.008164 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-96672259-62a5-4695-ba8b-bb806e79ce2d tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:36.008617 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-96672259-62a5-4695-ba8b-bb806e79ce2d tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:36.009050 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-96672259-62a5-4695-ba8b-bb806e79ce2d tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:36.009808 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-96672259-62a5-4695-ba8b-bb806e79ce2d tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:36.010237 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-96672259-62a5-4695-ba8b-bb806e79ce2d tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:36.010690 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-96672259-62a5-4695-ba8b-bb806e79ce2d tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:36.072358 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-96672259-62a5-4695-ba8b-bb806e79ce2d tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:36.079948 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-96672259-62a5-4695-ba8b-bb806e79ce2d tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1289 microversion: 2.1 time: 0.083668 Aug 06 14:30:36.080515 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 69/118] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:35 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1289 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:36.113053 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-5cd14d6b-3d9e-412b-99af-e66518749b12 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:36.117147 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-5cd14d6b-3d9e-412b-99af-e66518749b12 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] [instance: 0604e338-9ab8-40db-a076-0fb13ba92f24] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:36.123235 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5cd14d6b-3d9e-412b-99af-e66518749b12 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:36.123711 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5cd14d6b-3d9e-412b-99af-e66518749b12 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:36.124139 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5cd14d6b-3d9e-412b-99af-e66518749b12 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:36.124825 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5cd14d6b-3d9e-412b-99af-e66518749b12 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:36.125272 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5cd14d6b-3d9e-412b-99af-e66518749b12 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:36.125693 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5cd14d6b-3d9e-412b-99af-e66518749b12 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:36.192468 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-5cd14d6b-3d9e-412b-99af-e66518749b12 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1e8506e8b34a8d9c59b4acdbf23bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ead8c81ff3486683d21f671acac6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:36.201098 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-5cd14d6b-3d9e-412b-99af-e66518749b12 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] 10.222.0.17 "GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24" status: 200 len: 1284 microversion: 2.1 time: 0.092121 Aug 06 14:30:36.201667 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 50/119] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:36 2022] GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24 => generated 1284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:36.213328 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-a0a9d149-c471-47fc-a71c-ac9ae2e7aa39 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:36.213936 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-a0a9d149-c471-47fc-a71c-ac9ae2e7aa39 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:36.220914 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a0a9d149-c471-47fc-a71c-ac9ae2e7aa39 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:36.221398 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a0a9d149-c471-47fc-a71c-ac9ae2e7aa39 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:36.221827 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a0a9d149-c471-47fc-a71c-ac9ae2e7aa39 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:36.222510 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a0a9d149-c471-47fc-a71c-ac9ae2e7aa39 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:36.223025 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a0a9d149-c471-47fc-a71c-ac9ae2e7aa39 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:36.223444 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a0a9d149-c471-47fc-a71c-ac9ae2e7aa39 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:36.360026 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-a0a9d149-c471-47fc-a71c-ac9ae2e7aa39 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:36.368006 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-a0a9d149-c471-47fc-a71c-ac9ae2e7aa39 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1322 microversion: 2.1 time: 0.159210 Aug 06 14:30:36.368570 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 70/120] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:36 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:36.529095 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-2a390ef9-f19b-46bb-b3c2-eec1a12037ef tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:36.529667 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-2a390ef9-f19b-46bb-b3c2-eec1a12037ef tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:36.535738 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2a390ef9-f19b-46bb-b3c2-eec1a12037ef tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:36.536225 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2a390ef9-f19b-46bb-b3c2-eec1a12037ef tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:36.536655 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2a390ef9-f19b-46bb-b3c2-eec1a12037ef tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:36.537339 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2a390ef9-f19b-46bb-b3c2-eec1a12037ef tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:36.537786 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2a390ef9-f19b-46bb-b3c2-eec1a12037ef tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:36.538203 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2a390ef9-f19b-46bb-b3c2-eec1a12037ef tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:36.602522 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-2a390ef9-f19b-46bb-b3c2-eec1a12037ef tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:36.612499 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-2a390ef9-f19b-46bb-b3c2-eec1a12037ef tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:36.614019 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-2a390ef9-f19b-46bb-b3c2-eec1a12037ef tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:36.615215 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-2a390ef9-f19b-46bb-b3c2-eec1a12037ef tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1334 microversion: 2.20 time: 0.090050 Aug 06 14:30:36.615948 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 51/121] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:30:36 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1334 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:30:36.788825 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-debe4ef3-a539-4c84-b992-223926190f85 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:36.789375 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-debe4ef3-a539-4c84-b992-223926190f85 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6e717f01-c854-444e-9872-51e2c1c78987] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:36.795393 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-debe4ef3-a539-4c84-b992-223926190f85 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:36.795879 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-debe4ef3-a539-4c84-b992-223926190f85 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:36.796319 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-debe4ef3-a539-4c84-b992-223926190f85 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:36.797011 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-debe4ef3-a539-4c84-b992-223926190f85 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:36.797466 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-debe4ef3-a539-4c84-b992-223926190f85 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:36.797892 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-debe4ef3-a539-4c84-b992-223926190f85 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:36.861048 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-debe4ef3-a539-4c84-b992-223926190f85 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:36.869310 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-debe4ef3-a539-4c84-b992-223926190f85 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987" status: 200 len: 1293 microversion: 2.1 time: 0.084421 Aug 06 14:30:36.870081 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 71/122] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:36 2022] GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987 => generated 1293 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:37.100987 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-33154ad4-6a52-4b97-9e9a-16c7714d63d3 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:37.101558 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-33154ad4-6a52-4b97-9e9a-16c7714d63d3 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:37.107764 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-33154ad4-6a52-4b97-9e9a-16c7714d63d3 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:37.108255 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-33154ad4-6a52-4b97-9e9a-16c7714d63d3 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:37.108685 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-33154ad4-6a52-4b97-9e9a-16c7714d63d3 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:37.109366 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-33154ad4-6a52-4b97-9e9a-16c7714d63d3 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:37.109811 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-33154ad4-6a52-4b97-9e9a-16c7714d63d3 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:37.110231 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-33154ad4-6a52-4b97-9e9a-16c7714d63d3 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:37.173869 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-33154ad4-6a52-4b97-9e9a-16c7714d63d3 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:37.182547 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-33154ad4-6a52-4b97-9e9a-16c7714d63d3 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1289 microversion: 2.1 time: 0.085521 Aug 06 14:30:37.183145 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 52/123] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:37 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1289 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:37.222739 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-5a8bc4a6-f456-42ac-9da0-49374f007fa1 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:37.223377 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-5a8bc4a6-f456-42ac-9da0-49374f007fa1 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] [instance: 0604e338-9ab8-40db-a076-0fb13ba92f24] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:37.229989 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-5a8bc4a6-f456-42ac-9da0-49374f007fa1 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:37.230537 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-5a8bc4a6-f456-42ac-9da0-49374f007fa1 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:37.231001 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-5a8bc4a6-f456-42ac-9da0-49374f007fa1 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:37.232587 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-5a8bc4a6-f456-42ac-9da0-49374f007fa1 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:37.233044 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-5a8bc4a6-f456-42ac-9da0-49374f007fa1 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:37.233464 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-5a8bc4a6-f456-42ac-9da0-49374f007fa1 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:37.295935 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-5a8bc4a6-f456-42ac-9da0-49374f007fa1 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1e8506e8b34a8d9c59b4acdbf23bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ead8c81ff3486683d21f671acac6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:37.303522 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-5a8bc4a6-f456-42ac-9da0-49374f007fa1 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] 10.222.0.17 "GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24" status: 200 len: 1284 microversion: 2.1 time: 0.084595 Aug 06 14:30:37.304122 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 72/124] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:37 2022] GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24 => generated 1284 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:37.388211 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-f2ae0609-7ef1-4d6c-9d8e-9a9e37f882ca tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:37.388888 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-f2ae0609-7ef1-4d6c-9d8e-9a9e37f882ca tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:37.395356 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f2ae0609-7ef1-4d6c-9d8e-9a9e37f882ca tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:37.395836 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f2ae0609-7ef1-4d6c-9d8e-9a9e37f882ca tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:37.396271 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f2ae0609-7ef1-4d6c-9d8e-9a9e37f882ca tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:37.396993 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f2ae0609-7ef1-4d6c-9d8e-9a9e37f882ca tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:37.397446 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f2ae0609-7ef1-4d6c-9d8e-9a9e37f882ca tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:37.397879 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f2ae0609-7ef1-4d6c-9d8e-9a9e37f882ca tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:37.537082 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-f2ae0609-7ef1-4d6c-9d8e-9a9e37f882ca tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:37.545779 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-f2ae0609-7ef1-4d6c-9d8e-9a9e37f882ca tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1322 microversion: 2.1 time: 0.161364 Aug 06 14:30:37.547513 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 53/125] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:37 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:37.638189 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-f4243a9d-c5a3-4045-af01-691dacedb246 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:37.639046 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-f4243a9d-c5a3-4045-af01-691dacedb246 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:37.645461 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f4243a9d-c5a3-4045-af01-691dacedb246 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:37.646056 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f4243a9d-c5a3-4045-af01-691dacedb246 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:37.646496 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f4243a9d-c5a3-4045-af01-691dacedb246 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:37.647312 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f4243a9d-c5a3-4045-af01-691dacedb246 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:37.647769 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f4243a9d-c5a3-4045-af01-691dacedb246 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:37.648192 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f4243a9d-c5a3-4045-af01-691dacedb246 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:37.720329 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-f4243a9d-c5a3-4045-af01-691dacedb246 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:37.728846 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-f4243a9d-c5a3-4045-af01-691dacedb246 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:37.730328 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-f4243a9d-c5a3-4045-af01-691dacedb246 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:37.735840 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-f4243a9d-c5a3-4045-af01-691dacedb246 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1334 microversion: 2.20 time: 0.101528 Aug 06 14:30:37.736699 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 73/126] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:30:37 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1334 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:30:37.893527 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-7bb6365a-572a-4090-987b-303a606d76ea tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:37.894054 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-7bb6365a-572a-4090-987b-303a606d76ea tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6e717f01-c854-444e-9872-51e2c1c78987] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:37.900675 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7bb6365a-572a-4090-987b-303a606d76ea tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:37.901182 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7bb6365a-572a-4090-987b-303a606d76ea tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:37.901729 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7bb6365a-572a-4090-987b-303a606d76ea tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:37.902438 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7bb6365a-572a-4090-987b-303a606d76ea tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:37.902912 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7bb6365a-572a-4090-987b-303a606d76ea tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:37.903336 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7bb6365a-572a-4090-987b-303a606d76ea tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:37.973794 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-7bb6365a-572a-4090-987b-303a606d76ea tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:37.981443 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-7bb6365a-572a-4090-987b-303a606d76ea tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987" status: 200 len: 1293 microversion: 2.1 time: 0.091850 Aug 06 14:30:37.982004 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 54/127] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:37 2022] GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987 => generated 1293 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:38.203872 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-c1d9d6ec-d9cf-4c27-a74b-f9474f8fcd57 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:38.204437 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-c1d9d6ec-d9cf-4c27-a74b-f9474f8fcd57 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:38.210328 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c1d9d6ec-d9cf-4c27-a74b-f9474f8fcd57 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:38.210804 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c1d9d6ec-d9cf-4c27-a74b-f9474f8fcd57 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:38.211922 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c1d9d6ec-d9cf-4c27-a74b-f9474f8fcd57 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:38.212607 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c1d9d6ec-d9cf-4c27-a74b-f9474f8fcd57 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:38.213067 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c1d9d6ec-d9cf-4c27-a74b-f9474f8fcd57 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:38.213607 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c1d9d6ec-d9cf-4c27-a74b-f9474f8fcd57 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:38.327393 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-0c4addf1-d0cb-489e-9a5c-dcfa40feafaa tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:38.328392 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-0c4addf1-d0cb-489e-9a5c-dcfa40feafaa tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] [instance: 0604e338-9ab8-40db-a076-0fb13ba92f24] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:38.335965 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0c4addf1-d0cb-489e-9a5c-dcfa40feafaa tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:38.337092 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0c4addf1-d0cb-489e-9a5c-dcfa40feafaa tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:38.337898 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0c4addf1-d0cb-489e-9a5c-dcfa40feafaa tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:38.340122 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0c4addf1-d0cb-489e-9a5c-dcfa40feafaa tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:38.340962 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0c4addf1-d0cb-489e-9a5c-dcfa40feafaa tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:38.341671 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0c4addf1-d0cb-489e-9a5c-dcfa40feafaa tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:38.415770 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-0c4addf1-d0cb-489e-9a5c-dcfa40feafaa tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1e8506e8b34a8d9c59b4acdbf23bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ead8c81ff3486683d21f671acac6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:38.428235 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-0c4addf1-d0cb-489e-9a5c-dcfa40feafaa tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] 10.222.0.17 "GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24" status: 200 len: 1272 microversion: 2.1 time: 0.104628 Aug 06 14:30:38.429001 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 55/128] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:38 2022] GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24 => generated 1272 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:38.495542 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-c1d9d6ec-d9cf-4c27-a74b-f9474f8fcd57 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:38.505623 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-c1d9d6ec-d9cf-4c27-a74b-f9474f8fcd57 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1289 microversion: 2.1 time: 0.305877 Aug 06 14:30:38.506302 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 74/129] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:38 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1289 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:30:38.567547 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-5730f59c-a94e-4803-8763-292868287d93 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:38.568184 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-5730f59c-a94e-4803-8763-292868287d93 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:38.575439 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5730f59c-a94e-4803-8763-292868287d93 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:38.575919 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5730f59c-a94e-4803-8763-292868287d93 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:38.576345 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5730f59c-a94e-4803-8763-292868287d93 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:38.577028 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5730f59c-a94e-4803-8763-292868287d93 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:38.577475 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5730f59c-a94e-4803-8763-292868287d93 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:38.577894 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5730f59c-a94e-4803-8763-292868287d93 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:38.592589 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_cell1:SELECT=100 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:30:38.718947 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-5730f59c-a94e-4803-8763-292868287d93 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:38.726334 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-5730f59c-a94e-4803-8763-292868287d93 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1322 microversion: 2.1 time: 0.162615 Aug 06 14:30:38.727491 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 56/130] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:38 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:38.761079 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-b0129b40-a5ed-4297-8c85-e8bc5013b865 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:38.761731 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-b0129b40-a5ed-4297-8c85-e8bc5013b865 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:38.767813 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b0129b40-a5ed-4297-8c85-e8bc5013b865 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:38.768315 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b0129b40-a5ed-4297-8c85-e8bc5013b865 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:38.769069 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b0129b40-a5ed-4297-8c85-e8bc5013b865 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:38.769810 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b0129b40-a5ed-4297-8c85-e8bc5013b865 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:38.770319 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b0129b40-a5ed-4297-8c85-e8bc5013b865 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:38.770747 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b0129b40-a5ed-4297-8c85-e8bc5013b865 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:38.839341 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-b0129b40-a5ed-4297-8c85-e8bc5013b865 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:38.850006 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-b0129b40-a5ed-4297-8c85-e8bc5013b865 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:38.852564 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-b0129b40-a5ed-4297-8c85-e8bc5013b865 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:38.853834 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-b0129b40-a5ed-4297-8c85-e8bc5013b865 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1334 microversion: 2.20 time: 0.097954 Aug 06 14:30:38.854924 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 75/131] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:30:38 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1334 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:30:39.003827 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-7b52492b-fc9f-4284-b5da-77746d859e28 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:39.004535 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-7b52492b-fc9f-4284-b5da-77746d859e28 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6e717f01-c854-444e-9872-51e2c1c78987] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:39.021712 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7b52492b-fc9f-4284-b5da-77746d859e28 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:39.022223 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7b52492b-fc9f-4284-b5da-77746d859e28 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:39.024964 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7b52492b-fc9f-4284-b5da-77746d859e28 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:39.025712 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7b52492b-fc9f-4284-b5da-77746d859e28 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:39.028603 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7b52492b-fc9f-4284-b5da-77746d859e28 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:39.031715 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7b52492b-fc9f-4284-b5da-77746d859e28 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:39.213311 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-7b52492b-fc9f-4284-b5da-77746d859e28 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:39.233370 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-7b52492b-fc9f-4284-b5da-77746d859e28 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987" status: 200 len: 1311 microversion: 2.1 time: 0.234064 Aug 06 14:30:39.233961 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 57/132] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:38 2022] GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987 => generated 1311 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:39.453947 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-30afdeb2-d127-4747-8572-716a5608fd00 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:39.457157 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-30afdeb2-d127-4747-8572-716a5608fd00 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] [instance: 0604e338-9ab8-40db-a076-0fb13ba92f24] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:39.497217 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-30afdeb2-d127-4747-8572-716a5608fd00 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:39.498907 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-30afdeb2-d127-4747-8572-716a5608fd00 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:39.500097 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-30afdeb2-d127-4747-8572-716a5608fd00 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:39.501177 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-30afdeb2-d127-4747-8572-716a5608fd00 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:39.507686 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-30afdeb2-d127-4747-8572-716a5608fd00 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:39.509332 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-30afdeb2-d127-4747-8572-716a5608fd00 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:39.529163 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-78081b72-464b-4af3-9e68-571954f2bec6 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:39.529929 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-78081b72-464b-4af3-9e68-571954f2bec6 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:39.553114 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-78081b72-464b-4af3-9e68-571954f2bec6 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:39.562899 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-78081b72-464b-4af3-9e68-571954f2bec6 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:39.564202 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-78081b72-464b-4af3-9e68-571954f2bec6 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:39.566386 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-78081b72-464b-4af3-9e68-571954f2bec6 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:39.567656 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-78081b72-464b-4af3-9e68-571954f2bec6 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:39.573295 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-78081b72-464b-4af3-9e68-571954f2bec6 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:39.835204 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-30afdeb2-d127-4747-8572-716a5608fd00 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1e8506e8b34a8d9c59b4acdbf23bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ead8c81ff3486683d21f671acac6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:39.848226 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-30afdeb2-d127-4747-8572-716a5608fd00 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] 10.222.0.17 "GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24" status: 200 len: 1272 microversion: 2.1 time: 0.399430 Aug 06 14:30:39.849130 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 76/133] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:39 2022] GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24 => generated 1272 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:40.079746 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [req-1d0f712a-3eeb-49e8-8265-e0ae2ed17a02 req-dc55a051-9e26-41e7-8b22-f1cce0804e41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1cbde5c-7d9e-49cc-ba65-31507c04c60b", "name": "network-vif-plugged", "status": "completed", "tag": "a853325e-6939-4f2f-af26-cb207312c178"}]} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:30:40.096829 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-1d0f712a-3eeb-49e8-8265-e0ae2ed17a02 req-dc55a051-9e26-41e7-8b22-f1cce0804e41 service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:40.097627 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-1d0f712a-3eeb-49e8-8265-e0ae2ed17a02 req-dc55a051-9e26-41e7-8b22-f1cce0804e41 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:40.098153 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-1d0f712a-3eeb-49e8-8265-e0ae2ed17a02 req-dc55a051-9e26-41e7-8b22-f1cce0804e41 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:40.108629 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-78081b72-464b-4af3-9e68-571954f2bec6 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:40.118690 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-78081b72-464b-4af3-9e68-571954f2bec6 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1297 microversion: 2.1 time: 0.593988 Aug 06 14:30:40.120381 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 58/134] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:39 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1297 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:40.125874 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-4773f16a-b214-47af-ae68-41f6b43ea471 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:40.132484 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-4773f16a-b214-47af-ae68-41f6b43ea471 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:40.141375 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.compute.server_external_events [req-1d0f712a-3eeb-49e8-8265-e0ae2ed17a02 req-dc55a051-9e26-41e7-8b22-f1cce0804e41 service nova] Creating event network-vif-plugged:a853325e-6939-4f2f-af26-cb207312c178 for instance d1cbde5c-7d9e-49cc-ba65-31507c04c60b on hv-cinder-85199 Aug 06 14:30:40.150580 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4773f16a-b214-47af-ae68-41f6b43ea471 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:40.155237 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4773f16a-b214-47af-ae68-41f6b43ea471 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:40.158255 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4773f16a-b214-47af-ae68-41f6b43ea471 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:40.159221 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4773f16a-b214-47af-ae68-41f6b43ea471 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:40.159696 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4773f16a-b214-47af-ae68-41f6b43ea471 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:40.160122 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4773f16a-b214-47af-ae68-41f6b43ea471 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:40.163867 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [req-1d0f712a-3eeb-49e8-8265-e0ae2ed17a02 req-dc55a051-9e26-41e7-8b22-f1cce0804e41 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.311192 Aug 06 14:30:40.167566 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 77/135] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:30:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:30:40.194398 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-1e6f0960-25d3-475e-b8a3-655ab8de426d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:40.195172 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-1e6f0960-25d3-475e-b8a3-655ab8de426d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:40.211554 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1e6f0960-25d3-475e-b8a3-655ab8de426d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:40.212055 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1e6f0960-25d3-475e-b8a3-655ab8de426d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:40.221374 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1e6f0960-25d3-475e-b8a3-655ab8de426d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:40.222463 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1e6f0960-25d3-475e-b8a3-655ab8de426d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:40.233909 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1e6f0960-25d3-475e-b8a3-655ab8de426d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:40.234373 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1e6f0960-25d3-475e-b8a3-655ab8de426d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:40.382884 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-1e6f0960-25d3-475e-b8a3-655ab8de426d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:40.400166 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-1e6f0960-25d3-475e-b8a3-655ab8de426d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:40.408119 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-1e6f0960-25d3-475e-b8a3-655ab8de426d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:40.410575 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-1e6f0960-25d3-475e-b8a3-655ab8de426d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1340 microversion: 2.20 time: 0.238199 Aug 06 14:30:40.418750 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 78/136] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:30:40 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1340 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:30:40.436954 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-c5aece47-499e-4a94-83cd-a4dea45a1e2f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:40.437887 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-c5aece47-499e-4a94-83cd-a4dea45a1e2f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6e717f01-c854-444e-9872-51e2c1c78987] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:40.461353 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c5aece47-499e-4a94-83cd-a4dea45a1e2f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:40.464835 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c5aece47-499e-4a94-83cd-a4dea45a1e2f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:40.466427 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c5aece47-499e-4a94-83cd-a4dea45a1e2f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:40.468774 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c5aece47-499e-4a94-83cd-a4dea45a1e2f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:40.469485 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c5aece47-499e-4a94-83cd-a4dea45a1e2f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:40.472572 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c5aece47-499e-4a94-83cd-a4dea45a1e2f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:41.000516 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-c5aece47-499e-4a94-83cd-a4dea45a1e2f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:41.013167 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-c5aece47-499e-4a94-83cd-a4dea45a1e2f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987" status: 200 len: 1299 microversion: 2.1 time: 0.591890 Aug 06 14:30:41.014119 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 79/137] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:40 2022] GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987 => generated 1299 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:41.031453 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-f2b23a97-4500-4666-adad-1052babd7399 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:41.033798 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-f2b23a97-4500-4666-adad-1052babd7399 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] [instance: 0604e338-9ab8-40db-a076-0fb13ba92f24] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:41.050239 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f2b23a97-4500-4666-adad-1052babd7399 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:41.050992 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f2b23a97-4500-4666-adad-1052babd7399 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:41.052156 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f2b23a97-4500-4666-adad-1052babd7399 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:41.053085 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f2b23a97-4500-4666-adad-1052babd7399 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:41.054301 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f2b23a97-4500-4666-adad-1052babd7399 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:41.057340 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f2b23a97-4500-4666-adad-1052babd7399 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:41.128580 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-4773f16a-b214-47af-ae68-41f6b43ea471 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:41.145860 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-4773f16a-b214-47af-ae68-41f6b43ea471 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1322 microversion: 2.1 time: 1.023424 Aug 06 14:30:41.147463 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 59/138] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:40 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1322 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:41.153471 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-57509581-f1ef-499a-9370-2231f5f05756 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:41.154373 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-57509581-f1ef-499a-9370-2231f5f05756 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:41.171166 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-57509581-f1ef-499a-9370-2231f5f05756 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:41.172172 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-57509581-f1ef-499a-9370-2231f5f05756 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:41.173212 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-57509581-f1ef-499a-9370-2231f5f05756 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:41.174801 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-57509581-f1ef-499a-9370-2231f5f05756 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:41.175983 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-57509581-f1ef-499a-9370-2231f5f05756 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:41.177939 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-57509581-f1ef-499a-9370-2231f5f05756 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:41.274645 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-57509581-f1ef-499a-9370-2231f5f05756 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:41.290187 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-57509581-f1ef-499a-9370-2231f5f05756 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1295 microversion: 2.1 time: 0.141477 Aug 06 14:30:41.292442 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 60/139] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:41 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1295 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:41.442219 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-9097b53e-0482-4915-904a-3e451cd1f6b6 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:41.443370 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-9097b53e-0482-4915-904a-3e451cd1f6b6 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:41.451904 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9097b53e-0482-4915-904a-3e451cd1f6b6 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:41.452716 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9097b53e-0482-4915-904a-3e451cd1f6b6 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:41.453387 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9097b53e-0482-4915-904a-3e451cd1f6b6 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:41.454824 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9097b53e-0482-4915-904a-3e451cd1f6b6 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:41.456907 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9097b53e-0482-4915-904a-3e451cd1f6b6 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:41.457531 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9097b53e-0482-4915-904a-3e451cd1f6b6 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:41.482675 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-f2b23a97-4500-4666-adad-1052babd7399 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1e8506e8b34a8d9c59b4acdbf23bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ead8c81ff3486683d21f671acac6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:41.490388 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-f2b23a97-4500-4666-adad-1052babd7399 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] 10.222.0.17 "GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24" status: 200 len: 1314 microversion: 2.1 time: 0.469268 Aug 06 14:30:41.490986 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 80/140] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:41 2022] GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24 => generated 1314 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:41.602303 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-9097b53e-0482-4915-904a-3e451cd1f6b6 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:41.637632 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-9097b53e-0482-4915-904a-3e451cd1f6b6 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:41.639309 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-9097b53e-0482-4915-904a-3e451cd1f6b6 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:41.640461 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-9097b53e-0482-4915-904a-3e451cd1f6b6 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1340 microversion: 2.20 time: 0.202286 Aug 06 14:30:41.641068 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 61/141] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:30:41 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1340 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 14:30:42.036152 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-e83f887b-fdda-4bc1-9353-a1a1b36a9bc9 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:42.037323 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-e83f887b-fdda-4bc1-9353-a1a1b36a9bc9 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6e717f01-c854-444e-9872-51e2c1c78987] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:42.048922 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e83f887b-fdda-4bc1-9353-a1a1b36a9bc9 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:42.054692 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e83f887b-fdda-4bc1-9353-a1a1b36a9bc9 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:42.055439 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e83f887b-fdda-4bc1-9353-a1a1b36a9bc9 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:42.056189 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e83f887b-fdda-4bc1-9353-a1a1b36a9bc9 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:42.056653 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e83f887b-fdda-4bc1-9353-a1a1b36a9bc9 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:42.057132 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e83f887b-fdda-4bc1-9353-a1a1b36a9bc9 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:42.170353 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-739fff78-8944-4ff2-a169-40b5a1d21ea1 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:42.171944 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-739fff78-8944-4ff2-a169-40b5a1d21ea1 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:42.180113 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-739fff78-8944-4ff2-a169-40b5a1d21ea1 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:42.181055 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-739fff78-8944-4ff2-a169-40b5a1d21ea1 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:42.181790 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-739fff78-8944-4ff2-a169-40b5a1d21ea1 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:42.182688 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-739fff78-8944-4ff2-a169-40b5a1d21ea1 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:42.183305 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-739fff78-8944-4ff2-a169-40b5a1d21ea1 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:42.183870 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-739fff78-8944-4ff2-a169-40b5a1d21ea1 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:42.356105 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-e83f887b-fdda-4bc1-9353-a1a1b36a9bc9 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:42.364762 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-e83f887b-fdda-4bc1-9353-a1a1b36a9bc9 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987" status: 200 len: 1367 microversion: 2.1 time: 0.332978 Aug 06 14:30:42.367012 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 81/142] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:42 2022] GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987 => generated 1367 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:42.369268 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-739fff78-8944-4ff2-a169-40b5a1d21ea1 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:42.390560 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-739fff78-8944-4ff2-a169-40b5a1d21ea1 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1322 microversion: 2.1 time: 0.226148 Aug 06 14:30:42.391293 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 62/143] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:42 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1322 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:42.404599 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-817ebf79-bcec-4456-90ff-7216f578949b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:42.405249 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-817ebf79-bcec-4456-90ff-7216f578949b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:42.411403 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-817ebf79-bcec-4456-90ff-7216f578949b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:42.411954 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-817ebf79-bcec-4456-90ff-7216f578949b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:42.412654 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-817ebf79-bcec-4456-90ff-7216f578949b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:42.413062 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-817ebf79-bcec-4456-90ff-7216f578949b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:42.413705 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-817ebf79-bcec-4456-90ff-7216f578949b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:42.414884 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-817ebf79-bcec-4456-90ff-7216f578949b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:42.456469 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [req-6d182bcc-2e38-4033-ab9c-ade4c4f8f337 req-b398c437-0c31-4c04-98dd-600c4fb51f3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0604e338-9ab8-40db-a076-0fb13ba92f24", "tag": "7957f136-33e5-4e1d-b200-e7d9374401f8"}]} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:30:42.467327 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-6d182bcc-2e38-4033-ab9c-ade4c4f8f337 req-b398c437-0c31-4c04-98dd-600c4fb51f3d service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:42.467824 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-6d182bcc-2e38-4033-ab9c-ade4c4f8f337 req-b398c437-0c31-4c04-98dd-600c4fb51f3d service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:42.468438 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-6d182bcc-2e38-4033-ab9c-ade4c4f8f337 req-b398c437-0c31-4c04-98dd-600c4fb51f3d service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:42.481364 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.compute.server_external_events [req-6d182bcc-2e38-4033-ab9c-ade4c4f8f337 req-b398c437-0c31-4c04-98dd-600c4fb51f3d service nova] Creating event network-changed:7957f136-33e5-4e1d-b200-e7d9374401f8 for instance 0604e338-9ab8-40db-a076-0fb13ba92f24 on hv-cinder-85199 Aug 06 14:30:42.487259 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [req-6d182bcc-2e38-4033-ab9c-ade4c4f8f337 req-b398c437-0c31-4c04-98dd-600c4fb51f3d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117990 Aug 06 14:30:42.488106 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 82/144] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:30:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:30:42.497486 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-817ebf79-bcec-4456-90ff-7216f578949b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:42.511877 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-817ebf79-bcec-4456-90ff-7216f578949b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1295 microversion: 2.1 time: 0.119188 Aug 06 14:30:42.512760 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 63/145] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:42 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1295 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:42.515391 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-8ffb11aa-ed2a-47a6-8c02-5c05a32f3284 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:42.516320 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-8ffb11aa-ed2a-47a6-8c02-5c05a32f3284 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] [instance: 0604e338-9ab8-40db-a076-0fb13ba92f24] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:42.524238 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8ffb11aa-ed2a-47a6-8c02-5c05a32f3284 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:42.524979 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8ffb11aa-ed2a-47a6-8c02-5c05a32f3284 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:42.525629 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8ffb11aa-ed2a-47a6-8c02-5c05a32f3284 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:42.526394 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8ffb11aa-ed2a-47a6-8c02-5c05a32f3284 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:42.526946 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8ffb11aa-ed2a-47a6-8c02-5c05a32f3284 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:42.527426 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8ffb11aa-ed2a-47a6-8c02-5c05a32f3284 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:42.662987 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-55ae3e8d-75f7-4bdb-9693-6f21a046cb3e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:42.663595 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-55ae3e8d-75f7-4bdb-9693-6f21a046cb3e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:42.671185 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-8ffb11aa-ed2a-47a6-8c02-5c05a32f3284 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1e8506e8b34a8d9c59b4acdbf23bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ead8c81ff3486683d21f671acac6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:42.671782 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-55ae3e8d-75f7-4bdb-9693-6f21a046cb3e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:42.672461 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-55ae3e8d-75f7-4bdb-9693-6f21a046cb3e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:42.673321 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-55ae3e8d-75f7-4bdb-9693-6f21a046cb3e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:42.674210 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-55ae3e8d-75f7-4bdb-9693-6f21a046cb3e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:42.675092 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-55ae3e8d-75f7-4bdb-9693-6f21a046cb3e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:42.675723 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-55ae3e8d-75f7-4bdb-9693-6f21a046cb3e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:42.679319 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-8ffb11aa-ed2a-47a6-8c02-5c05a32f3284 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] 10.222.0.17 "GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24" status: 200 len: 1314 microversion: 2.1 time: 0.170405 Aug 06 14:30:42.680641 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 83/146] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:42 2022] GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:42.815727 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-55ae3e8d-75f7-4bdb-9693-6f21a046cb3e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:42.826778 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-55ae3e8d-75f7-4bdb-9693-6f21a046cb3e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:42.828318 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-55ae3e8d-75f7-4bdb-9693-6f21a046cb3e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:42.829467 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-55ae3e8d-75f7-4bdb-9693-6f21a046cb3e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1408 microversion: 2.20 time: 0.170364 Aug 06 14:30:42.830021 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 64/147] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:30:42 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1408 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 14:30:43.386195 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-112b054c-5c8b-4b1c-9cb3-bc823ec0e9a7 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:43.386800 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-112b054c-5c8b-4b1c-9cb3-bc823ec0e9a7 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6e717f01-c854-444e-9872-51e2c1c78987] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:43.393206 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-112b054c-5c8b-4b1c-9cb3-bc823ec0e9a7 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:43.393698 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-112b054c-5c8b-4b1c-9cb3-bc823ec0e9a7 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:43.394135 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-112b054c-5c8b-4b1c-9cb3-bc823ec0e9a7 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:43.394841 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-112b054c-5c8b-4b1c-9cb3-bc823ec0e9a7 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:43.395355 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-112b054c-5c8b-4b1c-9cb3-bc823ec0e9a7 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:43.395782 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-112b054c-5c8b-4b1c-9cb3-bc823ec0e9a7 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:43.410800 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-08dc1228-3682-4d40-92fb-e5efa50dcb3d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:43.411496 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-08dc1228-3682-4d40-92fb-e5efa50dcb3d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:43.417447 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-08dc1228-3682-4d40-92fb-e5efa50dcb3d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:43.417957 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-08dc1228-3682-4d40-92fb-e5efa50dcb3d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:43.418387 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-08dc1228-3682-4d40-92fb-e5efa50dcb3d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:43.419100 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-08dc1228-3682-4d40-92fb-e5efa50dcb3d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:43.419551 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-08dc1228-3682-4d40-92fb-e5efa50dcb3d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:43.419968 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-08dc1228-3682-4d40-92fb-e5efa50dcb3d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:43.525500 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-112b054c-5c8b-4b1c-9cb3-bc823ec0e9a7 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:43.533181 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-112b054c-5c8b-4b1c-9cb3-bc823ec0e9a7 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987" status: 200 len: 1367 microversion: 2.1 time: 0.151354 Aug 06 14:30:43.533742 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 84/148] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:43 2022] GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:43.538134 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-f08f33d3-eeaa-4145-9642-b74bfe302cc3 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:43.538730 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-f08f33d3-eeaa-4145-9642-b74bfe302cc3 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:43.544526 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f08f33d3-eeaa-4145-9642-b74bfe302cc3 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:43.545010 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f08f33d3-eeaa-4145-9642-b74bfe302cc3 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:43.545443 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f08f33d3-eeaa-4145-9642-b74bfe302cc3 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:43.546128 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f08f33d3-eeaa-4145-9642-b74bfe302cc3 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:43.546787 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f08f33d3-eeaa-4145-9642-b74bfe302cc3 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:43.547129 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f08f33d3-eeaa-4145-9642-b74bfe302cc3 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:43.550742 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-08dc1228-3682-4d40-92fb-e5efa50dcb3d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:43.559546 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-08dc1228-3682-4d40-92fb-e5efa50dcb3d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1322 microversion: 2.1 time: 0.152562 Aug 06 14:30:43.560114 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 65/149] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:43 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:30:43.565845 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_cell1:SELECT=100 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:30:43.610170 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-f08f33d3-eeaa-4145-9642-b74bfe302cc3 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:43.617883 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-f08f33d3-eeaa-4145-9642-b74bfe302cc3 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1295 microversion: 2.1 time: 0.082729 Aug 06 14:30:43.618443 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 85/150] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:43 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1295 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:43.701606 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-9e8b3c65-731e-4a7c-8f15-a5d862da662e tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:43.702225 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-9e8b3c65-731e-4a7c-8f15-a5d862da662e tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] [instance: 0604e338-9ab8-40db-a076-0fb13ba92f24] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:43.708135 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9e8b3c65-731e-4a7c-8f15-a5d862da662e tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:43.708615 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9e8b3c65-731e-4a7c-8f15-a5d862da662e tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:43.709049 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9e8b3c65-731e-4a7c-8f15-a5d862da662e tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:43.709728 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9e8b3c65-731e-4a7c-8f15-a5d862da662e tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:43.710180 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9e8b3c65-731e-4a7c-8f15-a5d862da662e tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:43.710597 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9e8b3c65-731e-4a7c-8f15-a5d862da662e tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:43.841626 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-9e8b3c65-731e-4a7c-8f15-a5d862da662e tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1e8506e8b34a8d9c59b4acdbf23bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ead8c81ff3486683d21f671acac6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:43.849728 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-9e8b3c65-731e-4a7c-8f15-a5d862da662e tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] 10.222.0.17 "GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24" status: 200 len: 1314 microversion: 2.1 time: 0.151821 Aug 06 14:30:43.850486 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 66/151] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:43 2022] GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:43.852341 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-c16f079f-30c1-4d5d-b8a4-e687154ccf88 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:43.853088 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-c16f079f-30c1-4d5d-b8a4-e687154ccf88 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:43.859205 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c16f079f-30c1-4d5d-b8a4-e687154ccf88 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:43.859684 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c16f079f-30c1-4d5d-b8a4-e687154ccf88 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:43.860111 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c16f079f-30c1-4d5d-b8a4-e687154ccf88 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:43.860793 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c16f079f-30c1-4d5d-b8a4-e687154ccf88 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:43.861240 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c16f079f-30c1-4d5d-b8a4-e687154ccf88 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:43.861656 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c16f079f-30c1-4d5d-b8a4-e687154ccf88 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:43.993992 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-c16f079f-30c1-4d5d-b8a4-e687154ccf88 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:44.002108 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-c16f079f-30c1-4d5d-b8a4-e687154ccf88 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:44.003659 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-c16f079f-30c1-4d5d-b8a4-e687154ccf88 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:44.004774 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-c16f079f-30c1-4d5d-b8a4-e687154ccf88 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1408 microversion: 2.20 time: 0.156307 Aug 06 14:30:44.005331 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 86/152] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:30:43 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:30:44.553674 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-74cf3a78-a0bb-470b-8856-279ef58272af tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:44.554276 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-74cf3a78-a0bb-470b-8856-279ef58272af tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6e717f01-c854-444e-9872-51e2c1c78987] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:44.560911 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-74cf3a78-a0bb-470b-8856-279ef58272af tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:44.561608 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-74cf3a78-a0bb-470b-8856-279ef58272af tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:44.562225 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-74cf3a78-a0bb-470b-8856-279ef58272af tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:44.562947 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-74cf3a78-a0bb-470b-8856-279ef58272af tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:44.563553 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-74cf3a78-a0bb-470b-8856-279ef58272af tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:44.563975 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-74cf3a78-a0bb-470b-8856-279ef58272af tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:44.581504 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-3ca10a33-be1b-4971-a372-6c943d573e16 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:44.582727 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-3ca10a33-be1b-4971-a372-6c943d573e16 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:44.592843 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:30:44.594958 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-3ca10a33-be1b-4971-a372-6c943d573e16 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:44.595715 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-3ca10a33-be1b-4971-a372-6c943d573e16 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:44.596354 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-3ca10a33-be1b-4971-a372-6c943d573e16 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:44.599204 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-3ca10a33-be1b-4971-a372-6c943d573e16 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:44.599679 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-3ca10a33-be1b-4971-a372-6c943d573e16 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:44.602723 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-3ca10a33-be1b-4971-a372-6c943d573e16 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:44.903928 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-74cf3a78-a0bb-470b-8856-279ef58272af tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:44.912144 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-74cf3a78-a0bb-470b-8856-279ef58272af tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987" status: 200 len: 1367 microversion: 2.1 time: 0.362225 Aug 06 14:30:44.912858 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 67/153] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:44 2022] GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987 => generated 1367 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:44.918075 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-686342fa-2ffe-4f3a-a3b6-74fbd1838bb9 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:44.919099 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-686342fa-2ffe-4f3a-a3b6-74fbd1838bb9 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:44.925985 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-686342fa-2ffe-4f3a-a3b6-74fbd1838bb9 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:44.926649 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-686342fa-2ffe-4f3a-a3b6-74fbd1838bb9 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:44.926912 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-686342fa-2ffe-4f3a-a3b6-74fbd1838bb9 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:44.927740 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-686342fa-2ffe-4f3a-a3b6-74fbd1838bb9 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:44.928229 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-686342fa-2ffe-4f3a-a3b6-74fbd1838bb9 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:44.928961 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-686342fa-2ffe-4f3a-a3b6-74fbd1838bb9 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:45.003768 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-686342fa-2ffe-4f3a-a3b6-74fbd1838bb9 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:45.018946 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-686342fa-2ffe-4f3a-a3b6-74fbd1838bb9 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1295 microversion: 2.1 time: 0.104810 Aug 06 14:30:45.019766 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 68/154] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:44 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1295 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:45.027049 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-9e1fa998-782b-4031-a576-11c545933b6d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:45.027667 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-9e1fa998-782b-4031-a576-11c545933b6d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] [instance: 0604e338-9ab8-40db-a076-0fb13ba92f24] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:45.038483 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9e1fa998-782b-4031-a576-11c545933b6d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:45.039134 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9e1fa998-782b-4031-a576-11c545933b6d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:45.039621 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9e1fa998-782b-4031-a576-11c545933b6d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:45.040337 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9e1fa998-782b-4031-a576-11c545933b6d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:45.040805 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9e1fa998-782b-4031-a576-11c545933b6d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:45.041206 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9e1fa998-782b-4031-a576-11c545933b6d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:45.213872 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-3ca10a33-be1b-4971-a372-6c943d573e16 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:45.224384 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-3ca10a33-be1b-4971-a372-6c943d573e16 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1322 microversion: 2.1 time: 0.646873 Aug 06 14:30:45.225648 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 87/155] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:44 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1322 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:45.234461 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-d8366ed6-3295-4a99-a0ee-75e8ff018c7b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:45.235390 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-d8366ed6-3295-4a99-a0ee-75e8ff018c7b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:45.241732 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d8366ed6-3295-4a99-a0ee-75e8ff018c7b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:45.242705 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d8366ed6-3295-4a99-a0ee-75e8ff018c7b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:45.243218 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d8366ed6-3295-4a99-a0ee-75e8ff018c7b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:45.243858 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d8366ed6-3295-4a99-a0ee-75e8ff018c7b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:45.244306 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d8366ed6-3295-4a99-a0ee-75e8ff018c7b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:45.244984 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d8366ed6-3295-4a99-a0ee-75e8ff018c7b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:45.259773 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-9e1fa998-782b-4031-a576-11c545933b6d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1e8506e8b34a8d9c59b4acdbf23bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ead8c81ff3486683d21f671acac6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:45.273679 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-9e1fa998-782b-4031-a576-11c545933b6d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] 10.222.0.17 "GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24" status: 200 len: 1314 microversion: 2.1 time: 0.252224 Aug 06 14:30:45.289483 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 69/156] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:45 2022] GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24 => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:45.532897 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-d8366ed6-3295-4a99-a0ee-75e8ff018c7b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:45.543039 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-d8366ed6-3295-4a99-a0ee-75e8ff018c7b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:45.545494 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-d8366ed6-3295-4a99-a0ee-75e8ff018c7b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:45.547342 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-d8366ed6-3295-4a99-a0ee-75e8ff018c7b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1408 microversion: 2.20 time: 0.318793 Aug 06 14:30:45.559811 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 88/157] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:30:45 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1408 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:30:45.936520 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-5ef20cd2-2010-4195-a383-08ec519dd8c0 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:45.937414 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-5ef20cd2-2010-4195-a383-08ec519dd8c0 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6e717f01-c854-444e-9872-51e2c1c78987] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:45.961871 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5ef20cd2-2010-4195-a383-08ec519dd8c0 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:45.965028 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5ef20cd2-2010-4195-a383-08ec519dd8c0 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:45.965753 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5ef20cd2-2010-4195-a383-08ec519dd8c0 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:45.971703 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5ef20cd2-2010-4195-a383-08ec519dd8c0 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:45.972403 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5ef20cd2-2010-4195-a383-08ec519dd8c0 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:45.972842 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5ef20cd2-2010-4195-a383-08ec519dd8c0 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:46.042363 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-bb3509cc-250a-440b-9c8a-ab16ec356e7d tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:46.043795 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-bb3509cc-250a-440b-9c8a-ab16ec356e7d tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:46.055741 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-bb3509cc-250a-440b-9c8a-ab16ec356e7d tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:46.056243 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-bb3509cc-250a-440b-9c8a-ab16ec356e7d tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:46.056683 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-bb3509cc-250a-440b-9c8a-ab16ec356e7d tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:46.057384 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-bb3509cc-250a-440b-9c8a-ab16ec356e7d tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:46.057835 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-bb3509cc-250a-440b-9c8a-ab16ec356e7d tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:46.058254 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-bb3509cc-250a-440b-9c8a-ab16ec356e7d tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:46.302964 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-bb3509cc-250a-440b-9c8a-ab16ec356e7d tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:46.312331 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-bb3509cc-250a-440b-9c8a-ab16ec356e7d tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1362 microversion: 2.1 time: 0.274809 Aug 06 14:30:46.313335 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 89/158] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:46 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1362 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:46.319435 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [req-2892e54a-c0f7-437a-a0d9-f088867cf7c4 req-cb5562e2-667a-4339-88b3-c9548d79b4fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cf29bae-83f8-43e3-9118-0fea5a019ff8", "tag": "988ecdda-956b-4c8b-8ee4-231ef3ed0bb2"}, {"name": "network-changed", "server_uuid": "6e717f01-c854-444e-9872-51e2c1c78987", "tag": "9540450a-1a6b-4c4e-972a-4fb6ca932a45"}]} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:30:46.333714 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-2892e54a-c0f7-437a-a0d9-f088867cf7c4 req-cb5562e2-667a-4339-88b3-c9548d79b4fd service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:46.334439 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-2892e54a-c0f7-437a-a0d9-f088867cf7c4 req-cb5562e2-667a-4339-88b3-c9548d79b4fd service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:46.334886 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-2892e54a-c0f7-437a-a0d9-f088867cf7c4 req-cb5562e2-667a-4339-88b3-c9548d79b4fd service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:46.343642 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-5ef20cd2-2010-4195-a383-08ec519dd8c0 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:46.353642 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-5ef20cd2-2010-4195-a383-08ec519dd8c0 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987" status: 200 len: 1367 microversion: 2.1 time: 0.423751 Aug 06 14:30:46.354531 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 70/159] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:45 2022] GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987 => generated 1367 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:46.358230 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.compute.server_external_events [req-2892e54a-c0f7-437a-a0d9-f088867cf7c4 req-cb5562e2-667a-4339-88b3-c9548d79b4fd service nova] Creating event network-changed:988ecdda-956b-4c8b-8ee4-231ef3ed0bb2 for instance 5cf29bae-83f8-43e3-9118-0fea5a019ff8 on hv-cinder-85199 Aug 06 14:30:46.358741 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.compute.server_external_events [req-2892e54a-c0f7-437a-a0d9-f088867cf7c4 req-cb5562e2-667a-4339-88b3-c9548d79b4fd service nova] Creating event network-changed:9540450a-1a6b-4c4e-972a-4fb6ca932a45 for instance 6e717f01-c854-444e-9872-51e2c1c78987 on hv-cinder-85199 Aug 06 14:30:46.359374 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-720503bf-b004-4c58-b49f-2cab62b83077 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:46.360713 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-720503bf-b004-4c58-b49f-2cab62b83077 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:46.366952 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-720503bf-b004-4c58-b49f-2cab62b83077 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:46.367459 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-720503bf-b004-4c58-b49f-2cab62b83077 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:46.367888 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-720503bf-b004-4c58-b49f-2cab62b83077 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:46.368765 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-720503bf-b004-4c58-b49f-2cab62b83077 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:46.369374 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-720503bf-b004-4c58-b49f-2cab62b83077 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:46.369897 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-720503bf-b004-4c58-b49f-2cab62b83077 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:46.371849 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [req-2892e54a-c0f7-437a-a0d9-f088867cf7c4 req-cb5562e2-667a-4339-88b3-c9548d79b4fd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.054100 Aug 06 14:30:46.372866 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 90/160] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:30:46 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:30:46.378709 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-e9e1eeed-a26f-4d21-9d9c-619977dd1e2f tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:46.379621 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-e9e1eeed-a26f-4d21-9d9c-619977dd1e2f tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] [instance: 0604e338-9ab8-40db-a076-0fb13ba92f24] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:46.386934 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e9e1eeed-a26f-4d21-9d9c-619977dd1e2f tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:46.387602 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e9e1eeed-a26f-4d21-9d9c-619977dd1e2f tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:46.388200 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e9e1eeed-a26f-4d21-9d9c-619977dd1e2f tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:46.388914 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e9e1eeed-a26f-4d21-9d9c-619977dd1e2f tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:46.389375 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e9e1eeed-a26f-4d21-9d9c-619977dd1e2f tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:46.389797 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e9e1eeed-a26f-4d21-9d9c-619977dd1e2f tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:46.544110 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-e9e1eeed-a26f-4d21-9d9c-619977dd1e2f tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1e8506e8b34a8d9c59b4acdbf23bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ead8c81ff3486683d21f671acac6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:46.552660 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-e9e1eeed-a26f-4d21-9d9c-619977dd1e2f tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] 10.222.0.17 "GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24" status: 200 len: 1314 microversion: 2.1 time: 0.178313 Aug 06 14:30:46.567441 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 91/161] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:46 2022] GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:46.574534 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-fccffba8-b81f-4308-8c80-946820e0e8ff tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:46.575022 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-fccffba8-b81f-4308-8c80-946820e0e8ff tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:46.582172 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-fccffba8-b81f-4308-8c80-946820e0e8ff tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:46.582698 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-fccffba8-b81f-4308-8c80-946820e0e8ff tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:46.583324 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-fccffba8-b81f-4308-8c80-946820e0e8ff tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:46.584259 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-fccffba8-b81f-4308-8c80-946820e0e8ff tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:46.584689 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-fccffba8-b81f-4308-8c80-946820e0e8ff tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:46.585125 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-fccffba8-b81f-4308-8c80-946820e0e8ff tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:46.671771 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-720503bf-b004-4c58-b49f-2cab62b83077 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:46.681647 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-720503bf-b004-4c58-b49f-2cab62b83077 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1322 microversion: 2.1 time: 0.326050 Aug 06 14:30:46.691802 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 71/162] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:46 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1322 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:46.744275 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-fccffba8-b81f-4308-8c80-946820e0e8ff tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:46.753206 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-fccffba8-b81f-4308-8c80-946820e0e8ff tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:46.755052 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-fccffba8-b81f-4308-8c80-946820e0e8ff tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:46.756574 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-fccffba8-b81f-4308-8c80-946820e0e8ff tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1408 microversion: 2.20 time: 0.186975 Aug 06 14:30:46.758980 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 92/163] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:30:46 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1408 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 14:30:46.796203 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [req-99c7bd80-38f3-4f5a-aafc-cc9e6f8b870b req-028767a9-6866-4b7d-a8cf-590455304f17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b9f7623-548a-4f92-8f60-9d7ee92e0fac", "tag": "f31381da-4bc7-4a30-94e4-9ebf8fa3aaf3"}]} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:30:46.810714 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-99c7bd80-38f3-4f5a-aafc-cc9e6f8b870b req-028767a9-6866-4b7d-a8cf-590455304f17 service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:46.811479 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-99c7bd80-38f3-4f5a-aafc-cc9e6f8b870b req-028767a9-6866-4b7d-a8cf-590455304f17 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:46.812540 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-99c7bd80-38f3-4f5a-aafc-cc9e6f8b870b req-028767a9-6866-4b7d-a8cf-590455304f17 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:46.838977 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.compute.server_external_events [req-99c7bd80-38f3-4f5a-aafc-cc9e6f8b870b req-028767a9-6866-4b7d-a8cf-590455304f17 service nova] Creating event network-changed:f31381da-4bc7-4a30-94e4-9ebf8fa3aaf3 for instance 8b9f7623-548a-4f92-8f60-9d7ee92e0fac on hv-cinder-85199 Aug 06 14:30:46.839525 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-99c7bd80-38f3-4f5a-aafc-cc9e6f8b870b req-028767a9-6866-4b7d-a8cf-590455304f17 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=117838) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 06 14:30:46.840125 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-99c7bd80-38f3-4f5a-aafc-cc9e6f8b870b req-028767a9-6866-4b7d-a8cf-590455304f17 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117838) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 06 14:30:46.841653 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d54bb0c8-7ff2-483b-8f4a-a6833ef01b10 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:46.842342 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d54bb0c8-7ff2-483b-8f4a-a6833ef01b10 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:46.843223 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d54bb0c8-7ff2-483b-8f4a-a6833ef01b10 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:46.844301 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d54bb0c8-7ff2-483b-8f4a-a6833ef01b10 None None] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:46.844978 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d54bb0c8-7ff2-483b-8f4a-a6833ef01b10 None None] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:46.845605 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d54bb0c8-7ff2-483b-8f4a-a6833ef01b10 None None] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:46.858271 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.compute.rpcapi [None req-d54bb0c8-7ff2-483b-8f4a-a6833ef01b10 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 06 14:30:46.859659 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d54bb0c8-7ff2-483b-8f4a-a6833ef01b10 None None] Releasing lock "compute-rpcapi-router" {{(pid=117838) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 06 14:30:46.878148 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-d54bb0c8-7ff2-483b-8f4a-a6833ef01b10 None None] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087333 Aug 06 14:30:46.878945 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 72/164] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:30:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:30:47.336810 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-fdc72dd6-cdd1-437f-8fd3-28cece1894f1 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:47.338286 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-fdc72dd6-cdd1-437f-8fd3-28cece1894f1 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:47.346501 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-fdc72dd6-cdd1-437f-8fd3-28cece1894f1 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:47.347038 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-fdc72dd6-cdd1-437f-8fd3-28cece1894f1 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:47.347481 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-fdc72dd6-cdd1-437f-8fd3-28cece1894f1 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:47.348194 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-fdc72dd6-cdd1-437f-8fd3-28cece1894f1 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:47.348649 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-fdc72dd6-cdd1-437f-8fd3-28cece1894f1 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:47.349296 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-fdc72dd6-cdd1-437f-8fd3-28cece1894f1 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:47.375577 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-cdb1b666-86e1-46e7-a210-2cb84f64cee8 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:47.376699 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-cdb1b666-86e1-46e7-a210-2cb84f64cee8 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6e717f01-c854-444e-9872-51e2c1c78987] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:47.396943 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-cdb1b666-86e1-46e7-a210-2cb84f64cee8 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:47.397865 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-cdb1b666-86e1-46e7-a210-2cb84f64cee8 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:47.398526 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-cdb1b666-86e1-46e7-a210-2cb84f64cee8 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:47.399277 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-cdb1b666-86e1-46e7-a210-2cb84f64cee8 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:47.399771 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-cdb1b666-86e1-46e7-a210-2cb84f64cee8 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:47.400205 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-cdb1b666-86e1-46e7-a210-2cb84f64cee8 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:47.418356 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_cell1:SELECT=100 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:30:47.522713 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-fdc72dd6-cdd1-437f-8fd3-28cece1894f1 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:47.530935 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-fdc72dd6-cdd1-437f-8fd3-28cece1894f1 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1362 microversion: 2.1 time: 0.200974 Aug 06 14:30:47.531675 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 93/165] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:47 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1362 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:47.579137 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-34c1a524-be1c-4c16-8584-927690db9432 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:47.580131 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-34c1a524-be1c-4c16-8584-927690db9432 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] [instance: 0604e338-9ab8-40db-a076-0fb13ba92f24] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:47.587205 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-34c1a524-be1c-4c16-8584-927690db9432 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:47.587981 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-34c1a524-be1c-4c16-8584-927690db9432 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:47.588623 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-34c1a524-be1c-4c16-8584-927690db9432 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:47.589794 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-34c1a524-be1c-4c16-8584-927690db9432 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:47.591251 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-34c1a524-be1c-4c16-8584-927690db9432 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:47.591895 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-34c1a524-be1c-4c16-8584-927690db9432 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:47.661454 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-cdb1b666-86e1-46e7-a210-2cb84f64cee8 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:47.671844 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-cdb1b666-86e1-46e7-a210-2cb84f64cee8 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987" status: 200 len: 1367 microversion: 2.1 time: 0.301305 Aug 06 14:30:47.687185 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 73/166] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:47 2022] GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987 => generated 1367 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:30:47.701573 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-734d84f7-4d49-46b3-8f71-b0e6b536bc32 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:47.702303 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-734d84f7-4d49-46b3-8f71-b0e6b536bc32 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:47.711284 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-734d84f7-4d49-46b3-8f71-b0e6b536bc32 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:47.711853 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-734d84f7-4d49-46b3-8f71-b0e6b536bc32 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:47.712188 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-734d84f7-4d49-46b3-8f71-b0e6b536bc32 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:47.713044 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-734d84f7-4d49-46b3-8f71-b0e6b536bc32 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:47.715027 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-734d84f7-4d49-46b3-8f71-b0e6b536bc32 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:47.715590 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-734d84f7-4d49-46b3-8f71-b0e6b536bc32 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:47.758090 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-34c1a524-be1c-4c16-8584-927690db9432 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1e8506e8b34a8d9c59b4acdbf23bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ead8c81ff3486683d21f671acac6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:47.767232 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-34c1a524-be1c-4c16-8584-927690db9432 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] 10.222.0.17 "GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24" status: 200 len: 1314 microversion: 2.1 time: 0.193987 Aug 06 14:30:47.767813 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 94/167] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:47 2022] GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:30:47.793218 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-956380bc-add5-462b-8a4b-81367b8d53c6 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:47.793720 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-956380bc-add5-462b-8a4b-81367b8d53c6 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:47.801391 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-956380bc-add5-462b-8a4b-81367b8d53c6 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:47.802201 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-956380bc-add5-462b-8a4b-81367b8d53c6 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:47.802647 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-956380bc-add5-462b-8a4b-81367b8d53c6 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:47.803667 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-956380bc-add5-462b-8a4b-81367b8d53c6 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:47.804294 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-956380bc-add5-462b-8a4b-81367b8d53c6 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:47.805697 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-956380bc-add5-462b-8a4b-81367b8d53c6 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:47.911909 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-734d84f7-4d49-46b3-8f71-b0e6b536bc32 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:47.920282 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-734d84f7-4d49-46b3-8f71-b0e6b536bc32 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1322 microversion: 2.1 time: 0.222438 Aug 06 14:30:47.921172 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 74/168] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:47 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1322 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:48.003048 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-956380bc-add5-462b-8a4b-81367b8d53c6 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:48.017668 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-956380bc-add5-462b-8a4b-81367b8d53c6 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:48.021760 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-956380bc-add5-462b-8a4b-81367b8d53c6 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:48.026644 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-956380bc-add5-462b-8a4b-81367b8d53c6 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1408 microversion: 2.20 time: 0.238256 Aug 06 14:30:48.039919 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 95/169] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:30:47 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1408 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:30:48.556928 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-7ca91757-d507-423b-a2a3-f69ade88c073 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:48.557667 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-7ca91757-d507-423b-a2a3-f69ade88c073 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:48.564896 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7ca91757-d507-423b-a2a3-f69ade88c073 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:48.565594 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7ca91757-d507-423b-a2a3-f69ade88c073 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:48.566015 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7ca91757-d507-423b-a2a3-f69ade88c073 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:48.566705 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7ca91757-d507-423b-a2a3-f69ade88c073 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:48.567191 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7ca91757-d507-423b-a2a3-f69ade88c073 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:48.567597 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7ca91757-d507-423b-a2a3-f69ade88c073 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:48.698773 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-b5099775-8e26-46e8-be38-204ad07a2681 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:48.699412 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-b5099775-8e26-46e8-be38-204ad07a2681 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6e717f01-c854-444e-9872-51e2c1c78987] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:48.710217 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b5099775-8e26-46e8-be38-204ad07a2681 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:48.711277 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b5099775-8e26-46e8-be38-204ad07a2681 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:48.711717 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b5099775-8e26-46e8-be38-204ad07a2681 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:48.712427 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b5099775-8e26-46e8-be38-204ad07a2681 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:48.714919 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b5099775-8e26-46e8-be38-204ad07a2681 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:48.715509 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b5099775-8e26-46e8-be38-204ad07a2681 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:48.751452 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-7ca91757-d507-423b-a2a3-f69ade88c073 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:48.774854 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-7ca91757-d507-423b-a2a3-f69ade88c073 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1362 microversion: 2.1 time: 0.223296 Aug 06 14:30:48.779427 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 75/170] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:48 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1362 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:48.788307 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-25d3168c-d498-4d08-bed1-1ab12b59d5cf tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:48.788955 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-25d3168c-d498-4d08-bed1-1ab12b59d5cf tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] [instance: 0604e338-9ab8-40db-a076-0fb13ba92f24] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:48.797282 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-25d3168c-d498-4d08-bed1-1ab12b59d5cf tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:48.797964 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-25d3168c-d498-4d08-bed1-1ab12b59d5cf tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:48.798620 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-25d3168c-d498-4d08-bed1-1ab12b59d5cf tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:48.799532 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-25d3168c-d498-4d08-bed1-1ab12b59d5cf tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:48.800855 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-25d3168c-d498-4d08-bed1-1ab12b59d5cf tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:48.802037 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-25d3168c-d498-4d08-bed1-1ab12b59d5cf tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:48.970042 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-b5099775-8e26-46e8-be38-204ad07a2681 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:48.982664 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-b5099775-8e26-46e8-be38-204ad07a2681 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987" status: 200 len: 1367 microversion: 2.1 time: 0.287758 Aug 06 14:30:48.984409 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 96/171] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:48 2022] GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987 => generated 1367 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:30:48.991554 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-a15395a5-30bd-4f32-8714-57cabc909014 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:48.993395 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-a15395a5-30bd-4f32-8714-57cabc909014 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:49.015561 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a15395a5-30bd-4f32-8714-57cabc909014 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:49.016683 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a15395a5-30bd-4f32-8714-57cabc909014 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:49.018943 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a15395a5-30bd-4f32-8714-57cabc909014 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:49.019983 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a15395a5-30bd-4f32-8714-57cabc909014 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:49.021996 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a15395a5-30bd-4f32-8714-57cabc909014 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:49.023851 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a15395a5-30bd-4f32-8714-57cabc909014 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:49.089147 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-25d3168c-d498-4d08-bed1-1ab12b59d5cf tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1e8506e8b34a8d9c59b4acdbf23bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ead8c81ff3486683d21f671acac6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:49.097319 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-25d3168c-d498-4d08-bed1-1ab12b59d5cf tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] 10.222.0.17 "GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24" status: 200 len: 1314 microversion: 2.1 time: 0.312926 Aug 06 14:30:49.102437 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 76/172] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:48 2022] GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24 => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:30:49.112267 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-ffe0aac2-f723-4f4f-ad15-697ecf3cdb88 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:49.113186 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-ffe0aac2-f723-4f4f-ad15-697ecf3cdb88 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:49.131004 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ffe0aac2-f723-4f4f-ad15-697ecf3cdb88 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:49.132004 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ffe0aac2-f723-4f4f-ad15-697ecf3cdb88 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:49.133597 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ffe0aac2-f723-4f4f-ad15-697ecf3cdb88 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:49.139564 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ffe0aac2-f723-4f4f-ad15-697ecf3cdb88 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:49.140127 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ffe0aac2-f723-4f4f-ad15-697ecf3cdb88 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:49.140764 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ffe0aac2-f723-4f4f-ad15-697ecf3cdb88 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:49.236886 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-a15395a5-30bd-4f32-8714-57cabc909014 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:49.246313 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-a15395a5-30bd-4f32-8714-57cabc909014 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1322 microversion: 2.1 time: 0.259947 Aug 06 14:30:49.260416 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 97/173] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:48 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1322 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:49.396181 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-ffe0aac2-f723-4f4f-ad15-697ecf3cdb88 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:49.404600 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-ffe0aac2-f723-4f4f-ad15-697ecf3cdb88 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:49.406086 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-ffe0aac2-f723-4f4f-ad15-697ecf3cdb88 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:49.407216 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-ffe0aac2-f723-4f4f-ad15-697ecf3cdb88 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1408 microversion: 2.20 time: 0.303290 Aug 06 14:30:49.407771 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 77/174] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:30:49 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1408 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:30:49.799812 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-3fd11fea-6eaf-4b16-b8b3-b96b24e4883c tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:49.800424 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-3fd11fea-6eaf-4b16-b8b3-b96b24e4883c tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:49.822143 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-3fd11fea-6eaf-4b16-b8b3-b96b24e4883c tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:49.822143 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-3fd11fea-6eaf-4b16-b8b3-b96b24e4883c tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:49.822143 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-3fd11fea-6eaf-4b16-b8b3-b96b24e4883c tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:49.822143 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-3fd11fea-6eaf-4b16-b8b3-b96b24e4883c tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:49.822443 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-3fd11fea-6eaf-4b16-b8b3-b96b24e4883c tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:49.822443 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-3fd11fea-6eaf-4b16-b8b3-b96b24e4883c tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:50.003594 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-ec021cdc-ea1a-4aad-8da8-3ed635e9bce1 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:50.004212 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-ec021cdc-ea1a-4aad-8da8-3ed635e9bce1 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6e717f01-c854-444e-9872-51e2c1c78987] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:50.012130 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ec021cdc-ea1a-4aad-8da8-3ed635e9bce1 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:50.012868 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ec021cdc-ea1a-4aad-8da8-3ed635e9bce1 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:50.013452 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ec021cdc-ea1a-4aad-8da8-3ed635e9bce1 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:50.014438 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ec021cdc-ea1a-4aad-8da8-3ed635e9bce1 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:50.015133 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ec021cdc-ea1a-4aad-8da8-3ed635e9bce1 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:50.015790 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ec021cdc-ea1a-4aad-8da8-3ed635e9bce1 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:50.202172 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-3fd11fea-6eaf-4b16-b8b3-b96b24e4883c tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:50.215685 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-3fd11fea-6eaf-4b16-b8b3-b96b24e4883c tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1362 microversion: 2.1 time: 0.419127 Aug 06 14:30:50.229014 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 98/175] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:49 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1362 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:50.229953 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-967d634a-7819-4a30-82d0-019aba8740e4 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:50.231725 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-967d634a-7819-4a30-82d0-019aba8740e4 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] [instance: 0604e338-9ab8-40db-a076-0fb13ba92f24] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:50.247480 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-967d634a-7819-4a30-82d0-019aba8740e4 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:50.250320 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-967d634a-7819-4a30-82d0-019aba8740e4 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:50.252272 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-967d634a-7819-4a30-82d0-019aba8740e4 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:50.254063 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-967d634a-7819-4a30-82d0-019aba8740e4 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:50.255818 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-967d634a-7819-4a30-82d0-019aba8740e4 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:50.258403 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-967d634a-7819-4a30-82d0-019aba8740e4 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:50.574441 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-967d634a-7819-4a30-82d0-019aba8740e4 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1e8506e8b34a8d9c59b4acdbf23bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ead8c81ff3486683d21f671acac6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:50.586673 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-967d634a-7819-4a30-82d0-019aba8740e4 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] 10.222.0.17 "GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24" status: 200 len: 1314 microversion: 2.1 time: 0.365381 Aug 06 14:30:50.589458 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 99/176] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:50 2022] GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24 => generated 1314 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:50.600719 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-867d0b66-2d24-4207-914a-cc1c78deda97 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:50.605826 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-867d0b66-2d24-4207-914a-cc1c78deda97 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:50.626947 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-867d0b66-2d24-4207-914a-cc1c78deda97 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:50.627692 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-867d0b66-2d24-4207-914a-cc1c78deda97 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:50.628311 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-867d0b66-2d24-4207-914a-cc1c78deda97 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:50.629252 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-867d0b66-2d24-4207-914a-cc1c78deda97 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:50.632029 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-867d0b66-2d24-4207-914a-cc1c78deda97 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:50.633433 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-867d0b66-2d24-4207-914a-cc1c78deda97 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:50.697848 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-ec021cdc-ea1a-4aad-8da8-3ed635e9bce1 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:50.709079 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-ec021cdc-ea1a-4aad-8da8-3ed635e9bce1 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987" status: 200 len: 1367 microversion: 2.1 time: 0.709579 Aug 06 14:30:50.712606 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 78/177] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:49 2022] GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987 => generated 1367 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:50.727885 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-3e9239e2-1455-4a9c-9952-7881d6c08533 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:50.728493 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-3e9239e2-1455-4a9c-9952-7881d6c08533 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:50.736360 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3e9239e2-1455-4a9c-9952-7881d6c08533 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:50.737078 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3e9239e2-1455-4a9c-9952-7881d6c08533 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:50.748249 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3e9239e2-1455-4a9c-9952-7881d6c08533 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:50.750528 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3e9239e2-1455-4a9c-9952-7881d6c08533 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:50.751416 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3e9239e2-1455-4a9c-9952-7881d6c08533 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:50.752465 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3e9239e2-1455-4a9c-9952-7881d6c08533 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:50.865861 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-867d0b66-2d24-4207-914a-cc1c78deda97 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:50.877932 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-867d0b66-2d24-4207-914a-cc1c78deda97 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1322 microversion: 2.1 time: 0.285756 Aug 06 14:30:50.879691 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 100/178] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:50 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1322 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:50.959484 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-3e9239e2-1455-4a9c-9952-7881d6c08533 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:50.968617 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-3e9239e2-1455-4a9c-9952-7881d6c08533 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:50.970189 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-3e9239e2-1455-4a9c-9952-7881d6c08533 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:50.971579 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-3e9239e2-1455-4a9c-9952-7881d6c08533 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1408 microversion: 2.20 time: 0.257632 Aug 06 14:30:50.972263 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 79/179] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:30:50 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1408 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:30:51.238750 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-661c8991-8c91-4e13-bef3-98d06508ce33 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:51.239696 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-661c8991-8c91-4e13-bef3-98d06508ce33 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:51.255793 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-661c8991-8c91-4e13-bef3-98d06508ce33 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:51.256472 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-661c8991-8c91-4e13-bef3-98d06508ce33 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:51.257085 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-661c8991-8c91-4e13-bef3-98d06508ce33 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:51.257817 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-661c8991-8c91-4e13-bef3-98d06508ce33 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:51.258275 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-661c8991-8c91-4e13-bef3-98d06508ce33 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:51.259119 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-661c8991-8c91-4e13-bef3-98d06508ce33 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:51.506376 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-661c8991-8c91-4e13-bef3-98d06508ce33 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:51.515055 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-661c8991-8c91-4e13-bef3-98d06508ce33 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1362 microversion: 2.1 time: 0.282316 Aug 06 14:30:51.515717 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 101/180] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:51 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1362 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:51.610405 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-4d7b2720-a3c2-4025-a2cb-5e368a1c4165 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:51.611049 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-4d7b2720-a3c2-4025-a2cb-5e368a1c4165 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] [instance: 0604e338-9ab8-40db-a076-0fb13ba92f24] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:51.619081 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4d7b2720-a3c2-4025-a2cb-5e368a1c4165 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:51.619599 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4d7b2720-a3c2-4025-a2cb-5e368a1c4165 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:51.620102 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4d7b2720-a3c2-4025-a2cb-5e368a1c4165 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:51.620920 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4d7b2720-a3c2-4025-a2cb-5e368a1c4165 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:51.621571 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4d7b2720-a3c2-4025-a2cb-5e368a1c4165 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:51.622175 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4d7b2720-a3c2-4025-a2cb-5e368a1c4165 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:51.732628 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-cea123e2-5500-4228-a986-b6bb5ffa6c9f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:51.733500 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-cea123e2-5500-4228-a986-b6bb5ffa6c9f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6e717f01-c854-444e-9872-51e2c1c78987] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:51.740067 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-cea123e2-5500-4228-a986-b6bb5ffa6c9f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:51.740786 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-cea123e2-5500-4228-a986-b6bb5ffa6c9f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:51.741577 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-cea123e2-5500-4228-a986-b6bb5ffa6c9f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:51.742480 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-cea123e2-5500-4228-a986-b6bb5ffa6c9f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:51.743052 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-cea123e2-5500-4228-a986-b6bb5ffa6c9f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:51.743624 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-cea123e2-5500-4228-a986-b6bb5ffa6c9f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:51.815107 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-4d7b2720-a3c2-4025-a2cb-5e368a1c4165 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1e8506e8b34a8d9c59b4acdbf23bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ead8c81ff3486683d21f671acac6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:51.824882 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-4d7b2720-a3c2-4025-a2cb-5e368a1c4165 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] 10.222.0.17 "GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24" status: 200 len: 1314 microversion: 2.1 time: 0.218876 Aug 06 14:30:51.829696 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 80/181] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:51 2022] GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:51.900058 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-a1b7bdbe-9132-41cc-8208-c2c206d3639c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:51.900895 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-a1b7bdbe-9132-41cc-8208-c2c206d3639c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:51.907441 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a1b7bdbe-9132-41cc-8208-c2c206d3639c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:51.908254 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a1b7bdbe-9132-41cc-8208-c2c206d3639c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:51.909754 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a1b7bdbe-9132-41cc-8208-c2c206d3639c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:51.910852 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a1b7bdbe-9132-41cc-8208-c2c206d3639c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:51.911615 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a1b7bdbe-9132-41cc-8208-c2c206d3639c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:51.912468 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a1b7bdbe-9132-41cc-8208-c2c206d3639c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:51.933681 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-cea123e2-5500-4228-a986-b6bb5ffa6c9f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:51.937571 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_cell1:SELECT=100 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:30:51.943246 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-cea123e2-5500-4228-a986-b6bb5ffa6c9f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987" status: 200 len: 1367 microversion: 2.1 time: 0.214192 Aug 06 14:30:51.944238 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 102/182] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:51 2022] GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987 => generated 1367 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:30:51.994731 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-64d498ca-a76f-4e8d-a2cc-03e7305003ae tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:51.995419 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-64d498ca-a76f-4e8d-a2cc-03e7305003ae tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:52.001994 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-64d498ca-a76f-4e8d-a2cc-03e7305003ae tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:52.002562 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-64d498ca-a76f-4e8d-a2cc-03e7305003ae tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:52.002993 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-64d498ca-a76f-4e8d-a2cc-03e7305003ae tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:52.003789 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-64d498ca-a76f-4e8d-a2cc-03e7305003ae tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:52.004500 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-64d498ca-a76f-4e8d-a2cc-03e7305003ae tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:52.005154 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-64d498ca-a76f-4e8d-a2cc-03e7305003ae tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:52.115976 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-a1b7bdbe-9132-41cc-8208-c2c206d3639c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:52.126240 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-a1b7bdbe-9132-41cc-8208-c2c206d3639c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1322 microversion: 2.1 time: 0.230946 Aug 06 14:30:52.128119 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 81/183] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:51 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1322 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:30:52.221537 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-64d498ca-a76f-4e8d-a2cc-03e7305003ae tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:52.231713 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-64d498ca-a76f-4e8d-a2cc-03e7305003ae tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:52.233574 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-64d498ca-a76f-4e8d-a2cc-03e7305003ae tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:52.235985 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-64d498ca-a76f-4e8d-a2cc-03e7305003ae tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1408 microversion: 2.20 time: 0.245146 Aug 06 14:30:52.236717 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 103/184] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:30:51 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1408 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:30:52.536918 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-45e0186b-1ed7-4960-aa43-38e1d5133ee3 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:52.537526 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-45e0186b-1ed7-4960-aa43-38e1d5133ee3 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:52.557947 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-45e0186b-1ed7-4960-aa43-38e1d5133ee3 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:52.560526 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-45e0186b-1ed7-4960-aa43-38e1d5133ee3 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:52.561212 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-45e0186b-1ed7-4960-aa43-38e1d5133ee3 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:52.563348 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-45e0186b-1ed7-4960-aa43-38e1d5133ee3 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:52.565669 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-45e0186b-1ed7-4960-aa43-38e1d5133ee3 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:52.566351 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-45e0186b-1ed7-4960-aa43-38e1d5133ee3 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:52.777684 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [req-7cf01c93-329a-4ffe-9e79-9cf1cb21126e req-f0ce6d44-6056-4471-bf18-1016642f0679 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02ac0364-de9e-4a71-8210-dc3fcd23a33e", "name": "network-vif-plugged", "status": "completed", "tag": "d9afb021-ae4d-4646-9676-3bc5246cf024"}]} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:30:52.791008 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-7cf01c93-329a-4ffe-9e79-9cf1cb21126e req-f0ce6d44-6056-4471-bf18-1016642f0679 service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:52.791724 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-7cf01c93-329a-4ffe-9e79-9cf1cb21126e req-f0ce6d44-6056-4471-bf18-1016642f0679 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:52.792300 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-7cf01c93-329a-4ffe-9e79-9cf1cb21126e req-f0ce6d44-6056-4471-bf18-1016642f0679 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:52.800434 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-45e0186b-1ed7-4960-aa43-38e1d5133ee3 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:52.808909 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-45e0186b-1ed7-4960-aa43-38e1d5133ee3 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1362 microversion: 2.1 time: 0.275751 Aug 06 14:30:52.809473 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 82/185] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:52 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1362 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:30:52.838658 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.compute.server_external_events [req-7cf01c93-329a-4ffe-9e79-9cf1cb21126e req-f0ce6d44-6056-4471-bf18-1016642f0679 service nova] Creating event network-vif-plugged:d9afb021-ae4d-4646-9676-3bc5246cf024 for instance 02ac0364-de9e-4a71-8210-dc3fcd23a33e on hv-cinder-85199 Aug 06 14:30:52.853249 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [req-7cf01c93-329a-4ffe-9e79-9cf1cb21126e req-f0ce6d44-6056-4471-bf18-1016642f0679 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080884 Aug 06 14:30:52.854163 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 104/186] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:30:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:30:52.856686 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-8a585df4-08cd-4c06-829d-850e29066e32 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:52.857462 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-8a585df4-08cd-4c06-829d-850e29066e32 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] [instance: 0604e338-9ab8-40db-a076-0fb13ba92f24] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:52.865885 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8a585df4-08cd-4c06-829d-850e29066e32 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:52.866541 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8a585df4-08cd-4c06-829d-850e29066e32 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:52.867276 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8a585df4-08cd-4c06-829d-850e29066e32 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:52.868038 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8a585df4-08cd-4c06-829d-850e29066e32 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:52.868520 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8a585df4-08cd-4c06-829d-850e29066e32 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:52.868940 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8a585df4-08cd-4c06-829d-850e29066e32 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:52.965899 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-db2d7ab8-68e4-4fbe-831f-d3aea09a36e0 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:52.966718 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-db2d7ab8-68e4-4fbe-831f-d3aea09a36e0 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6e717f01-c854-444e-9872-51e2c1c78987] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:52.975599 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-db2d7ab8-68e4-4fbe-831f-d3aea09a36e0 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:52.976344 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-db2d7ab8-68e4-4fbe-831f-d3aea09a36e0 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:52.976781 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-db2d7ab8-68e4-4fbe-831f-d3aea09a36e0 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:52.977947 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-db2d7ab8-68e4-4fbe-831f-d3aea09a36e0 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:52.979213 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-db2d7ab8-68e4-4fbe-831f-d3aea09a36e0 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:52.979810 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-db2d7ab8-68e4-4fbe-831f-d3aea09a36e0 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:53.159760 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-8a585df4-08cd-4c06-829d-850e29066e32 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1e8506e8b34a8d9c59b4acdbf23bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ead8c81ff3486683d21f671acac6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:53.168347 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-8a585df4-08cd-4c06-829d-850e29066e32 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] 10.222.0.17 "GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24" status: 200 len: 1314 microversion: 2.1 time: 0.319687 Aug 06 14:30:53.172042 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 83/187] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:52 2022] GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24 => generated 1314 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:30:53.178999 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-f86ec8bf-67d3-4f18-b6c1-d707ac1b4979 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:53.183494 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-f86ec8bf-67d3-4f18-b6c1-d707ac1b4979 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:53.204079 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f86ec8bf-67d3-4f18-b6c1-d707ac1b4979 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:53.204582 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f86ec8bf-67d3-4f18-b6c1-d707ac1b4979 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:53.205017 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f86ec8bf-67d3-4f18-b6c1-d707ac1b4979 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:53.205721 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f86ec8bf-67d3-4f18-b6c1-d707ac1b4979 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:53.206165 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f86ec8bf-67d3-4f18-b6c1-d707ac1b4979 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:53.206592 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f86ec8bf-67d3-4f18-b6c1-d707ac1b4979 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:53.239680 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-db2d7ab8-68e4-4fbe-831f-d3aea09a36e0 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:53.248135 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-db2d7ab8-68e4-4fbe-831f-d3aea09a36e0 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987" status: 200 len: 1367 microversion: 2.1 time: 0.288014 Aug 06 14:30:53.249193 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 105/188] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:52 2022] GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987 => generated 1367 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:53.259579 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-45baeacc-7d9e-456a-8994-48395a987989 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:53.260441 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-45baeacc-7d9e-456a-8994-48395a987989 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:53.266570 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-45baeacc-7d9e-456a-8994-48395a987989 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:53.267431 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-45baeacc-7d9e-456a-8994-48395a987989 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:53.268172 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-45baeacc-7d9e-456a-8994-48395a987989 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:53.269334 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-45baeacc-7d9e-456a-8994-48395a987989 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:53.269916 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-45baeacc-7d9e-456a-8994-48395a987989 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:53.270723 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-45baeacc-7d9e-456a-8994-48395a987989 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:53.403402 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-f86ec8bf-67d3-4f18-b6c1-d707ac1b4979 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:53.417408 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-f86ec8bf-67d3-4f18-b6c1-d707ac1b4979 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1322 microversion: 2.1 time: 0.242542 Aug 06 14:30:53.418711 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 84/189] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:53 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1322 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:53.440793 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-45baeacc-7d9e-456a-8994-48395a987989 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:53.450266 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-45baeacc-7d9e-456a-8994-48395a987989 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:53.452245 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-45baeacc-7d9e-456a-8994-48395a987989 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:53.453782 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-45baeacc-7d9e-456a-8994-48395a987989 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1408 microversion: 2.20 time: 0.198282 Aug 06 14:30:53.467952 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 106/190] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:30:53 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1408 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:30:53.832739 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-48a42739-93e4-4879-b358-a70e06dd24dc tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:53.833584 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-48a42739-93e4-4879-b358-a70e06dd24dc tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:53.848561 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-48a42739-93e4-4879-b358-a70e06dd24dc tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:53.849688 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-48a42739-93e4-4879-b358-a70e06dd24dc tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:53.850436 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-48a42739-93e4-4879-b358-a70e06dd24dc tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:53.851969 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-48a42739-93e4-4879-b358-a70e06dd24dc tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:53.852644 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-48a42739-93e4-4879-b358-a70e06dd24dc tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:53.853057 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-48a42739-93e4-4879-b358-a70e06dd24dc tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:53.995029 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-48a42739-93e4-4879-b358-a70e06dd24dc tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:54.003198 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-48a42739-93e4-4879-b358-a70e06dd24dc tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1362 microversion: 2.1 time: 0.176954 Aug 06 14:30:54.004096 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 85/191] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:53 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1362 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:54.190384 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-04123f34-d8ed-478b-9a6c-cd9366372967 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:54.191283 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-04123f34-d8ed-478b-9a6c-cd9366372967 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] [instance: 0604e338-9ab8-40db-a076-0fb13ba92f24] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:54.197476 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-04123f34-d8ed-478b-9a6c-cd9366372967 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:54.198067 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-04123f34-d8ed-478b-9a6c-cd9366372967 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:54.201797 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-04123f34-d8ed-478b-9a6c-cd9366372967 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:54.201797 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-04123f34-d8ed-478b-9a6c-cd9366372967 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:54.201797 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-04123f34-d8ed-478b-9a6c-cd9366372967 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:54.201797 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-04123f34-d8ed-478b-9a6c-cd9366372967 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:54.271847 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-397ddc57-73eb-492e-a0fb-da53a153bc65 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:54.273926 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-397ddc57-73eb-492e-a0fb-da53a153bc65 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6e717f01-c854-444e-9872-51e2c1c78987] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:54.282418 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-397ddc57-73eb-492e-a0fb-da53a153bc65 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:54.283040 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-397ddc57-73eb-492e-a0fb-da53a153bc65 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:54.283552 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-397ddc57-73eb-492e-a0fb-da53a153bc65 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:54.285545 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-397ddc57-73eb-492e-a0fb-da53a153bc65 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:54.286023 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-397ddc57-73eb-492e-a0fb-da53a153bc65 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:54.286979 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-397ddc57-73eb-492e-a0fb-da53a153bc65 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:54.371060 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-04123f34-d8ed-478b-9a6c-cd9366372967 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1e8506e8b34a8d9c59b4acdbf23bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ead8c81ff3486683d21f671acac6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:54.380835 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-04123f34-d8ed-478b-9a6c-cd9366372967 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] 10.222.0.17 "GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24" status: 200 len: 1314 microversion: 2.1 time: 0.194958 Aug 06 14:30:54.381963 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 107/192] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:54 2022] GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:54.439615 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-b2ba6fbc-3a6b-44d7-8cca-dad84ff2021c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:54.440266 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-b2ba6fbc-3a6b-44d7-8cca-dad84ff2021c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:54.451151 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b2ba6fbc-3a6b-44d7-8cca-dad84ff2021c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:54.452893 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-397ddc57-73eb-492e-a0fb-da53a153bc65 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:54.453375 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b2ba6fbc-3a6b-44d7-8cca-dad84ff2021c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:54.453821 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b2ba6fbc-3a6b-44d7-8cca-dad84ff2021c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:54.454537 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b2ba6fbc-3a6b-44d7-8cca-dad84ff2021c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:54.455026 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b2ba6fbc-3a6b-44d7-8cca-dad84ff2021c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:54.455457 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b2ba6fbc-3a6b-44d7-8cca-dad84ff2021c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:54.462780 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-397ddc57-73eb-492e-a0fb-da53a153bc65 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987" status: 200 len: 1367 microversion: 2.1 time: 0.197248 Aug 06 14:30:54.475681 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 86/193] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:54 2022] GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987 => generated 1367 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:54.487067 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-22668fd7-cb3b-41ff-a7d5-304dc22708d1 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:54.487937 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-22668fd7-cb3b-41ff-a7d5-304dc22708d1 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:54.496760 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-22668fd7-cb3b-41ff-a7d5-304dc22708d1 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:54.497427 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-22668fd7-cb3b-41ff-a7d5-304dc22708d1 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:54.498034 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-22668fd7-cb3b-41ff-a7d5-304dc22708d1 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:54.499309 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-22668fd7-cb3b-41ff-a7d5-304dc22708d1 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:54.499964 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-22668fd7-cb3b-41ff-a7d5-304dc22708d1 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:54.500522 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-22668fd7-cb3b-41ff-a7d5-304dc22708d1 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:54.683631 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-b2ba6fbc-3a6b-44d7-8cca-dad84ff2021c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:54.691237 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-b2ba6fbc-3a6b-44d7-8cca-dad84ff2021c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1322 microversion: 2.1 time: 0.256098 Aug 06 14:30:54.693686 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 108/194] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:54 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1322 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:54.777917 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-22668fd7-cb3b-41ff-a7d5-304dc22708d1 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:54.790753 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-22668fd7-cb3b-41ff-a7d5-304dc22708d1 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:54.793302 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-22668fd7-cb3b-41ff-a7d5-304dc22708d1 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:54.795087 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-22668fd7-cb3b-41ff-a7d5-304dc22708d1 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1408 microversion: 2.20 time: 0.317577 Aug 06 14:30:54.802922 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 87/195] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:30:54 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1408 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:30:55.025074 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-89bb2093-4e19-4cf0-9a62-c3bc69f37a5f tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:55.025698 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-89bb2093-4e19-4cf0-9a62-c3bc69f37a5f tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:55.032058 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-89bb2093-4e19-4cf0-9a62-c3bc69f37a5f tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:55.032536 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-89bb2093-4e19-4cf0-9a62-c3bc69f37a5f tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:55.032973 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-89bb2093-4e19-4cf0-9a62-c3bc69f37a5f tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:55.033702 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-89bb2093-4e19-4cf0-9a62-c3bc69f37a5f tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:55.034158 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-89bb2093-4e19-4cf0-9a62-c3bc69f37a5f tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:55.034767 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-89bb2093-4e19-4cf0-9a62-c3bc69f37a5f tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:55.192583 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-89bb2093-4e19-4cf0-9a62-c3bc69f37a5f tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:55.202040 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-89bb2093-4e19-4cf0-9a62-c3bc69f37a5f tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1362 microversion: 2.1 time: 0.181363 Aug 06 14:30:55.202781 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 109/196] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:55 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:55.404277 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-c7fcf03e-b9f6-4399-8a32-b4ea3158ac82 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:55.405018 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-c7fcf03e-b9f6-4399-8a32-b4ea3158ac82 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] [instance: 0604e338-9ab8-40db-a076-0fb13ba92f24] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:55.422127 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c7fcf03e-b9f6-4399-8a32-b4ea3158ac82 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:55.425645 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c7fcf03e-b9f6-4399-8a32-b4ea3158ac82 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:55.428330 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c7fcf03e-b9f6-4399-8a32-b4ea3158ac82 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:55.434043 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c7fcf03e-b9f6-4399-8a32-b4ea3158ac82 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:55.437594 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c7fcf03e-b9f6-4399-8a32-b4ea3158ac82 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:55.441677 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c7fcf03e-b9f6-4399-8a32-b4ea3158ac82 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:55.504025 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-62c97b65-560c-45e2-884c-acc00bfe0805 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:55.504659 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-62c97b65-560c-45e2-884c-acc00bfe0805 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6e717f01-c854-444e-9872-51e2c1c78987] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:55.520194 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-62c97b65-560c-45e2-884c-acc00bfe0805 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:55.520685 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-62c97b65-560c-45e2-884c-acc00bfe0805 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:55.521149 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-62c97b65-560c-45e2-884c-acc00bfe0805 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:55.521876 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-62c97b65-560c-45e2-884c-acc00bfe0805 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:55.535153 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-62c97b65-560c-45e2-884c-acc00bfe0805 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:55.535883 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-62c97b65-560c-45e2-884c-acc00bfe0805 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:55.699335 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-c7fcf03e-b9f6-4399-8a32-b4ea3158ac82 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1e8506e8b34a8d9c59b4acdbf23bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ead8c81ff3486683d21f671acac6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:55.710349 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-c7fcf03e-b9f6-4399-8a32-b4ea3158ac82 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] 10.222.0.17 "GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24" status: 200 len: 1314 microversion: 2.1 time: 0.310037 Aug 06 14:30:55.711642 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 88/197] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:55 2022] GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24 => generated 1314 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:55.719844 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-b644d78d-6eb0-4a22-a884-c6ebbb329256 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:55.722776 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-b644d78d-6eb0-4a22-a884-c6ebbb329256 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:55.735739 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b644d78d-6eb0-4a22-a884-c6ebbb329256 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:55.736569 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b644d78d-6eb0-4a22-a884-c6ebbb329256 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:55.737240 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b644d78d-6eb0-4a22-a884-c6ebbb329256 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:55.738138 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b644d78d-6eb0-4a22-a884-c6ebbb329256 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:55.738575 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b644d78d-6eb0-4a22-a884-c6ebbb329256 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:55.739095 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b644d78d-6eb0-4a22-a884-c6ebbb329256 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:55.763214 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-62c97b65-560c-45e2-884c-acc00bfe0805 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:55.776997 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-62c97b65-560c-45e2-884c-acc00bfe0805 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987" status: 200 len: 1367 microversion: 2.1 time: 0.294679 Aug 06 14:30:55.777934 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 110/198] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:55 2022] GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987 => generated 1367 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:55.820174 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-f4e8d0a1-01bc-47d8-a35b-9a88b57f48aa tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:55.821533 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-f4e8d0a1-01bc-47d8-a35b-9a88b57f48aa tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:55.830357 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f4e8d0a1-01bc-47d8-a35b-9a88b57f48aa tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:55.831659 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f4e8d0a1-01bc-47d8-a35b-9a88b57f48aa tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:55.832562 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f4e8d0a1-01bc-47d8-a35b-9a88b57f48aa tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:55.833736 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f4e8d0a1-01bc-47d8-a35b-9a88b57f48aa tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:55.835292 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f4e8d0a1-01bc-47d8-a35b-9a88b57f48aa tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:55.836661 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f4e8d0a1-01bc-47d8-a35b-9a88b57f48aa tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:55.892875 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-b644d78d-6eb0-4a22-a884-c6ebbb329256 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:55.900945 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-b644d78d-6eb0-4a22-a884-c6ebbb329256 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1322 microversion: 2.1 time: 0.187388 Aug 06 14:30:55.902107 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 89/199] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:55 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:55.992819 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-f4e8d0a1-01bc-47d8-a35b-9a88b57f48aa tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:56.000655 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-f4e8d0a1-01bc-47d8-a35b-9a88b57f48aa tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:56.002172 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-f4e8d0a1-01bc-47d8-a35b-9a88b57f48aa tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:56.003321 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-f4e8d0a1-01bc-47d8-a35b-9a88b57f48aa tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1408 microversion: 2.20 time: 0.188580 Aug 06 14:30:56.003884 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 111/200] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:30:55 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1408 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 14:30:56.223407 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-7fcbb9ff-cd1c-4645-ad5a-ba14424ce4f7 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:56.224130 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-7fcbb9ff-cd1c-4645-ad5a-ba14424ce4f7 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:56.230211 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7fcbb9ff-cd1c-4645-ad5a-ba14424ce4f7 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:56.230688 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7fcbb9ff-cd1c-4645-ad5a-ba14424ce4f7 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:56.231146 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7fcbb9ff-cd1c-4645-ad5a-ba14424ce4f7 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:56.231826 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7fcbb9ff-cd1c-4645-ad5a-ba14424ce4f7 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:56.232276 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7fcbb9ff-cd1c-4645-ad5a-ba14424ce4f7 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:56.232691 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7fcbb9ff-cd1c-4645-ad5a-ba14424ce4f7 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:56.236566 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_cell1:SELECT=100 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:30:56.362467 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-7fcbb9ff-cd1c-4645-ad5a-ba14424ce4f7 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:56.370267 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-7fcbb9ff-cd1c-4645-ad5a-ba14424ce4f7 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1362 microversion: 2.1 time: 0.150658 Aug 06 14:30:56.370837 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 90/201] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:56 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:56.635552 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-aa26083e-ee82-4a8b-bfe4-dd78cfa70da0 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2021100850", "imageRef": "13d7ee60-c9c3-43ee-9861-a9192a114a77", "flavorRef": "452"}} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:30:56.687808 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.network.neutron [None req-aa26083e-ee82-4a8b-bfe4-dd78cfa70da0 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] validate_networks() for None {{(pid=117837) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 14:30:56.733462 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-bf89b7ac-774c-4ac8-bb0a-38db549bf86d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:56.734905 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-bf89b7ac-774c-4ac8-bb0a-38db549bf86d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] [instance: 0604e338-9ab8-40db-a076-0fb13ba92f24] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:56.741015 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-bf89b7ac-774c-4ac8-bb0a-38db549bf86d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:56.742318 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-bf89b7ac-774c-4ac8-bb0a-38db549bf86d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:56.743019 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-bf89b7ac-774c-4ac8-bb0a-38db549bf86d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:56.744097 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-bf89b7ac-774c-4ac8-bb0a-38db549bf86d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:56.745036 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-bf89b7ac-774c-4ac8-bb0a-38db549bf86d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:56.745772 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-bf89b7ac-774c-4ac8-bb0a-38db549bf86d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:56.855408 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_cell0:SELECT=2 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:30:56.938990 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-bf89b7ac-774c-4ac8-bb0a-38db549bf86d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1e8506e8b34a8d9c59b4acdbf23bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ead8c81ff3486683d21f671acac6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:56.949018 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-bf89b7ac-774c-4ac8-bb0a-38db549bf86d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] 10.222.0.17 "GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24" status: 200 len: 1314 microversion: 2.1 time: 0.219851 Aug 06 14:30:56.950130 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 91/202] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:56 2022] GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:30:56.956144 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-c95dcaf8-fa7b-457d-a143-632ba776a5e0 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:56.957116 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-c95dcaf8-fa7b-457d-a143-632ba776a5e0 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6e717f01-c854-444e-9872-51e2c1c78987] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:56.971062 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c95dcaf8-fa7b-457d-a143-632ba776a5e0 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:56.973094 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c95dcaf8-fa7b-457d-a143-632ba776a5e0 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:56.974576 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c95dcaf8-fa7b-457d-a143-632ba776a5e0 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:56.976712 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c95dcaf8-fa7b-457d-a143-632ba776a5e0 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:56.977606 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c95dcaf8-fa7b-457d-a143-632ba776a5e0 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:56.977934 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c95dcaf8-fa7b-457d-a143-632ba776a5e0 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:57.141167 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-c95dcaf8-fa7b-457d-a143-632ba776a5e0 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:57.149121 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-c95dcaf8-fa7b-457d-a143-632ba776a5e0 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987" status: 200 len: 1367 microversion: 2.1 time: 0.197598 Aug 06 14:30:57.149687 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 92/203] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:56 2022] GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987 => generated 1367 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:57.162423 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-9763ad81-fdd1-4904-ab97-4c07796e97d6 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:57.162423 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-9763ad81-fdd1-4904-ab97-4c07796e97d6 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:57.162423 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9763ad81-fdd1-4904-ab97-4c07796e97d6 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:57.162423 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9763ad81-fdd1-4904-ab97-4c07796e97d6 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:57.163237 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9763ad81-fdd1-4904-ab97-4c07796e97d6 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:57.164549 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9763ad81-fdd1-4904-ab97-4c07796e97d6 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:57.165002 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9763ad81-fdd1-4904-ab97-4c07796e97d6 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:57.165422 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9763ad81-fdd1-4904-ab97-4c07796e97d6 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:57.205326 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.virt.hardware [None req-aa26083e-ee82-4a8b-bfe4-dd78cfa70da0 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Flavor limits 0:0:0 {{(pid=117837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 14:30:57.205862 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.virt.hardware [None req-aa26083e-ee82-4a8b-bfe4-dd78cfa70da0 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Image limits 0:0:0 {{(pid=117837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 14:30:57.206405 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.virt.hardware [None req-aa26083e-ee82-4a8b-bfe4-dd78cfa70da0 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Flavor pref 0:0:0 {{(pid=117837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 14:30:57.206819 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.virt.hardware [None req-aa26083e-ee82-4a8b-bfe4-dd78cfa70da0 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Image pref 0:0:0 {{(pid=117837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 14:30:57.207440 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.virt.hardware [None req-aa26083e-ee82-4a8b-bfe4-dd78cfa70da0 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 14:30:57.217555 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-aa26083e-ee82-4a8b-bfe4-dd78cfa70da0 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:57.218128 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-aa26083e-ee82-4a8b-bfe4-dd78cfa70da0 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:57.218784 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-aa26083e-ee82-4a8b-bfe4-dd78cfa70da0 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:57.219622 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-aa26083e-ee82-4a8b-bfe4-dd78cfa70da0 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:57.220153 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-aa26083e-ee82-4a8b-bfe4-dd78cfa70da0 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:57.220645 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-aa26083e-ee82-4a8b-bfe4-dd78cfa70da0 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:57.238942 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.quota [None req-aa26083e-ee82-4a8b-bfe4-dd78cfa70da0 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Getting quotas for project 1d02ee1ad57f4d38acf0bc95ab43f614. Resources: {'cores', 'instances', 'ram'} {{(pid=117837) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 14:30:57.258118 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.quota [None req-aa26083e-ee82-4a8b-bfe4-dd78cfa70da0 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Getting quotas for user de557945688e4d9f944310015bb42163 and project 1d02ee1ad57f4d38acf0bc95ab43f614. Resources: {'cores', 'instances', 'ram'} {{(pid=117837) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 14:30:57.270733 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-aa26083e-ee82-4a8b-bfe4-dd78cfa70da0 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Going to run 1 instances... {{(pid=117837) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 14:30:57.273865 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-aa26083e-ee82-4a8b-bfe4-dd78cfa70da0 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] [instance: 4a7abdbc-0453-43a8-9668-f1b377162d8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='13d7ee60-c9c3-43ee-9861-a9192a114a77',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117837) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 14:30:57.308112 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-9763ad81-fdd1-4904-ab97-4c07796e97d6 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:57.316886 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-9763ad81-fdd1-4904-ab97-4c07796e97d6 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1322 microversion: 2.1 time: 0.166145 Aug 06 14:30:57.317450 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 93/204] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:57 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:57.330421 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [req-363c9723-7249-4ff9-8bfe-b0b3380c4594 req-b69e3cc0-30d6-4926-b98a-fa0253b276f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cf29bae-83f8-43e3-9118-0fea5a019ff8", "name": "network-vif-plugged", "status": "completed", "tag": "988ecdda-956b-4c8b-8ee4-231ef3ed0bb2"}]} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:30:57.332190 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-363c9723-7249-4ff9-8bfe-b0b3380c4594 req-b69e3cc0-30d6-4926-b98a-fa0253b276f9 service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:57.332321 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-aa26083e-ee82-4a8b-bfe4-dd78cfa70da0 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.701308 Aug 06 14:30:57.332676 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-363c9723-7249-4ff9-8bfe-b0b3380c4594 req-b69e3cc0-30d6-4926-b98a-fa0253b276f9 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:57.333244 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 112/205] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Aug 6 14:30:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 14:30:57.333358 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-363c9723-7249-4ff9-8bfe-b0b3380c4594 req-b69e3cc0-30d6-4926-b98a-fa0253b276f9 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:57.344042 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-96199288-b588-41d6-bd3e-5e8468fb6276 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:57.344814 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-96199288-b588-41d6-bd3e-5e8468fb6276 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:57.346074 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.compute.server_external_events [req-363c9723-7249-4ff9-8bfe-b0b3380c4594 req-b69e3cc0-30d6-4926-b98a-fa0253b276f9 service nova] Creating event network-vif-plugged:988ecdda-956b-4c8b-8ee4-231ef3ed0bb2 for instance 5cf29bae-83f8-43e3-9118-0fea5a019ff8 on hv-cinder-85199 Aug 06 14:30:57.352080 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-96199288-b588-41d6-bd3e-5e8468fb6276 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:57.352556 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-96199288-b588-41d6-bd3e-5e8468fb6276 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:57.352984 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-96199288-b588-41d6-bd3e-5e8468fb6276 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:57.353674 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-96199288-b588-41d6-bd3e-5e8468fb6276 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:57.354288 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-96199288-b588-41d6-bd3e-5e8468fb6276 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:57.354691 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [req-363c9723-7249-4ff9-8bfe-b0b3380c4594 req-b69e3cc0-30d6-4926-b98a-fa0253b276f9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035380 Aug 06 14:30:57.354791 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-96199288-b588-41d6-bd3e-5e8468fb6276 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:57.360654 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 94/206] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:30:57.367082 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-239fed06-d965-41a2-b67f-bd66d2a8fc83 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:57.367882 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-239fed06-d965-41a2-b67f-bd66d2a8fc83 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] [instance: 4a7abdbc-0453-43a8-9668-f1b377162d8f] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:57.376202 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_api:SELECT=100 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:30:57.441570 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-239fed06-d965-41a2-b67f-bd66d2a8fc83 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de557945688e4d9f944310015bb42163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d02ee1ad57f4d38acf0bc95ab43f614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:57.449860 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-239fed06-d965-41a2-b67f-bd66d2a8fc83 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] 10.222.0.17 "GET /compute/v2.1/servers/4a7abdbc-0453-43a8-9668-f1b377162d8f" status: 200 len: 1215 microversion: 2.1 time: 0.088081 Aug 06 14:30:57.450618 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 95/207] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:57 2022] GET /compute/v2.1/servers/4a7abdbc-0453-43a8-9668-f1b377162d8f => generated 1215 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:57.454998 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-206b9c2b-4dec-40ef-8edb-68d0af43d6ac tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:57.455508 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-206b9c2b-4dec-40ef-8edb-68d0af43d6ac tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:57.462190 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-206b9c2b-4dec-40ef-8edb-68d0af43d6ac tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:57.462673 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-206b9c2b-4dec-40ef-8edb-68d0af43d6ac tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:57.463331 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-206b9c2b-4dec-40ef-8edb-68d0af43d6ac tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:57.464217 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-206b9c2b-4dec-40ef-8edb-68d0af43d6ac tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:57.465049 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-206b9c2b-4dec-40ef-8edb-68d0af43d6ac tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:57.465927 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-206b9c2b-4dec-40ef-8edb-68d0af43d6ac tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:57.521259 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-96199288-b588-41d6-bd3e-5e8468fb6276 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:57.531338 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-96199288-b588-41d6-bd3e-5e8468fb6276 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:57.532972 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-96199288-b588-41d6-bd3e-5e8468fb6276 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:57.534100 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-96199288-b588-41d6-bd3e-5e8468fb6276 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1408 microversion: 2.20 time: 0.199988 Aug 06 14:30:57.534641 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 113/208] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:30:57 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1408 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:30:57.625345 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-206b9c2b-4dec-40ef-8edb-68d0af43d6ac tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:57.636346 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-206b9c2b-4dec-40ef-8edb-68d0af43d6ac tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1362 microversion: 2.1 time: 0.184739 Aug 06 14:30:57.637514 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 96/209] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:57 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1362 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:57.971644 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-7c3be27a-7fbc-4e19-af9e-2371634db1a4 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:57.972384 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-7c3be27a-7fbc-4e19-af9e-2371634db1a4 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] [instance: 0604e338-9ab8-40db-a076-0fb13ba92f24] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:57.978991 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7c3be27a-7fbc-4e19-af9e-2371634db1a4 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:57.979486 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7c3be27a-7fbc-4e19-af9e-2371634db1a4 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:57.979923 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7c3be27a-7fbc-4e19-af9e-2371634db1a4 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:57.980628 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7c3be27a-7fbc-4e19-af9e-2371634db1a4 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:57.981085 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7c3be27a-7fbc-4e19-af9e-2371634db1a4 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:57.981516 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7c3be27a-7fbc-4e19-af9e-2371634db1a4 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:58.111200 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-7c3be27a-7fbc-4e19-af9e-2371634db1a4 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1e8506e8b34a8d9c59b4acdbf23bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ead8c81ff3486683d21f671acac6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:58.119330 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-7c3be27a-7fbc-4e19-af9e-2371634db1a4 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] 10.222.0.17 "GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24" status: 200 len: 1314 microversion: 2.1 time: 0.151423 Aug 06 14:30:58.120099 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 114/210] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:57 2022] GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:58.170286 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-6de334d2-3653-41af-acaf-7fc24e577476 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:58.170919 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-6de334d2-3653-41af-acaf-7fc24e577476 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6e717f01-c854-444e-9872-51e2c1c78987] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:58.176863 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6de334d2-3653-41af-acaf-7fc24e577476 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:58.177339 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6de334d2-3653-41af-acaf-7fc24e577476 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:58.177771 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6de334d2-3653-41af-acaf-7fc24e577476 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:58.178453 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6de334d2-3653-41af-acaf-7fc24e577476 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:58.178960 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6de334d2-3653-41af-acaf-7fc24e577476 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:58.179965 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6de334d2-3653-41af-acaf-7fc24e577476 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:58.340246 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-f7e60e88-3f87-422d-94c5-f8d8febe14d2 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:58.340846 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-f7e60e88-3f87-422d-94c5-f8d8febe14d2 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:58.351787 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f7e60e88-3f87-422d-94c5-f8d8febe14d2 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:58.352399 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f7e60e88-3f87-422d-94c5-f8d8febe14d2 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:58.352839 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f7e60e88-3f87-422d-94c5-f8d8febe14d2 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:58.353645 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f7e60e88-3f87-422d-94c5-f8d8febe14d2 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:58.354130 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f7e60e88-3f87-422d-94c5-f8d8febe14d2 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:58.354620 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f7e60e88-3f87-422d-94c5-f8d8febe14d2 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:58.515070 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-6de334d2-3653-41af-acaf-7fc24e577476 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:58.527368 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-6de334d2-3653-41af-acaf-7fc24e577476 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987" status: 200 len: 1367 microversion: 2.1 time: 0.356270 Aug 06 14:30:58.542600 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 97/211] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:58 2022] GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987 => generated 1367 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:58.548056 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-a80d2990-dc95-4314-8414-eb47635c3d28 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:58.548982 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-a80d2990-dc95-4314-8414-eb47635c3d28 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] [instance: 4a7abdbc-0453-43a8-9668-f1b377162d8f] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:58.573891 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a80d2990-dc95-4314-8414-eb47635c3d28 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:58.574759 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a80d2990-dc95-4314-8414-eb47635c3d28 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:58.575431 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a80d2990-dc95-4314-8414-eb47635c3d28 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:58.576443 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a80d2990-dc95-4314-8414-eb47635c3d28 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:58.577642 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a80d2990-dc95-4314-8414-eb47635c3d28 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:58.578287 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a80d2990-dc95-4314-8414-eb47635c3d28 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:58.671645 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-a80d2990-dc95-4314-8414-eb47635c3d28 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de557945688e4d9f944310015bb42163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d02ee1ad57f4d38acf0bc95ab43f614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:58.681438 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-a80d2990-dc95-4314-8414-eb47635c3d28 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] 10.222.0.17 "GET /compute/v2.1/servers/4a7abdbc-0453-43a8-9668-f1b377162d8f" status: 200 len: 1267 microversion: 2.1 time: 0.137015 Aug 06 14:30:58.694897 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 98/212] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:58 2022] GET /compute/v2.1/servers/4a7abdbc-0453-43a8-9668-f1b377162d8f => generated 1267 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:58.694897 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-8c951c94-203d-4ae4-a11f-de10eff43e2c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:58.694897 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-8c951c94-203d-4ae4-a11f-de10eff43e2c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:58.700899 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8c951c94-203d-4ae4-a11f-de10eff43e2c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:58.701380 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8c951c94-203d-4ae4-a11f-de10eff43e2c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:58.702053 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8c951c94-203d-4ae4-a11f-de10eff43e2c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:58.702816 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8c951c94-203d-4ae4-a11f-de10eff43e2c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:58.703213 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8c951c94-203d-4ae4-a11f-de10eff43e2c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:58.703829 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8c951c94-203d-4ae4-a11f-de10eff43e2c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:58.743932 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-f7e60e88-3f87-422d-94c5-f8d8febe14d2 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:58.752903 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-f7e60e88-3f87-422d-94c5-f8d8febe14d2 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1322 microversion: 2.1 time: 0.418558 Aug 06 14:30:58.754157 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 115/213] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:58 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1322 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:58.759554 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-7dd86864-b517-4c89-a20e-bfb2f4aa2a83 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:58.760377 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-7dd86864-b517-4c89-a20e-bfb2f4aa2a83 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:58.769648 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7dd86864-b517-4c89-a20e-bfb2f4aa2a83 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:58.770279 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7dd86864-b517-4c89-a20e-bfb2f4aa2a83 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:58.771497 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7dd86864-b517-4c89-a20e-bfb2f4aa2a83 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:58.772343 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7dd86864-b517-4c89-a20e-bfb2f4aa2a83 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:58.773494 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7dd86864-b517-4c89-a20e-bfb2f4aa2a83 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:58.774000 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7dd86864-b517-4c89-a20e-bfb2f4aa2a83 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:58.908404 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-8c951c94-203d-4ae4-a11f-de10eff43e2c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:58.921423 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-8c951c94-203d-4ae4-a11f-de10eff43e2c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:58.923137 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-8c951c94-203d-4ae4-a11f-de10eff43e2c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:58.924294 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-8c951c94-203d-4ae4-a11f-de10eff43e2c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1408 microversion: 2.20 time: 0.235141 Aug 06 14:30:58.927071 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 99/214] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:30:58 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1408 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:30:58.974513 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-7dd86864-b517-4c89-a20e-bfb2f4aa2a83 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:58.985309 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-7dd86864-b517-4c89-a20e-bfb2f4aa2a83 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1362 microversion: 2.1 time: 0.229825 Aug 06 14:30:58.985957 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 116/215] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:58 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1362 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:59.141384 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-d327d684-9d03-4854-9b1b-f5177322b078 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:59.142023 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-d327d684-9d03-4854-9b1b-f5177322b078 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] [instance: 0604e338-9ab8-40db-a076-0fb13ba92f24] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:59.147924 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d327d684-9d03-4854-9b1b-f5177322b078 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:59.148916 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d327d684-9d03-4854-9b1b-f5177322b078 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:59.149347 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d327d684-9d03-4854-9b1b-f5177322b078 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:59.150032 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d327d684-9d03-4854-9b1b-f5177322b078 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:59.150484 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d327d684-9d03-4854-9b1b-f5177322b078 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:59.150927 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d327d684-9d03-4854-9b1b-f5177322b078 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:59.276042 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-d327d684-9d03-4854-9b1b-f5177322b078 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1e8506e8b34a8d9c59b4acdbf23bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ead8c81ff3486683d21f671acac6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:59.283342 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-d327d684-9d03-4854-9b1b-f5177322b078 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] 10.222.0.17 "GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24" status: 200 len: 1314 microversion: 2.1 time: 0.145696 Aug 06 14:30:59.283910 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 100/216] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:59 2022] GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:59.377157 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [req-fd830e6a-c156-4d29-b2e5-0d4c26c9a9bb req-59da2349-8429-474f-ba8b-6e090cabe38c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e717f01-c854-444e-9872-51e2c1c78987", "name": "network-vif-plugged", "status": "completed", "tag": "9540450a-1a6b-4c4e-972a-4fb6ca932a45"}]} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:30:59.387702 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-fd830e6a-c156-4d29-b2e5-0d4c26c9a9bb req-59da2349-8429-474f-ba8b-6e090cabe38c service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:59.388188 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-fd830e6a-c156-4d29-b2e5-0d4c26c9a9bb req-59da2349-8429-474f-ba8b-6e090cabe38c service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:59.388623 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-fd830e6a-c156-4d29-b2e5-0d4c26c9a9bb req-59da2349-8429-474f-ba8b-6e090cabe38c service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:59.400083 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.compute.server_external_events [req-fd830e6a-c156-4d29-b2e5-0d4c26c9a9bb req-59da2349-8429-474f-ba8b-6e090cabe38c service nova] Creating event network-vif-plugged:9540450a-1a6b-4c4e-972a-4fb6ca932a45 for instance 6e717f01-c854-444e-9872-51e2c1c78987 on hv-cinder-85199 Aug 06 14:30:59.405102 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [req-fd830e6a-c156-4d29-b2e5-0d4c26c9a9bb req-59da2349-8429-474f-ba8b-6e090cabe38c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031669 Aug 06 14:30:59.405686 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 117/217] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:30:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:30:59.549420 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-19693cbf-83c2-4c85-88eb-5e047380ef4f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:59.550190 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-19693cbf-83c2-4c85-88eb-5e047380ef4f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6e717f01-c854-444e-9872-51e2c1c78987] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:59.558498 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-19693cbf-83c2-4c85-88eb-5e047380ef4f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:59.559017 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-19693cbf-83c2-4c85-88eb-5e047380ef4f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:59.559452 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-19693cbf-83c2-4c85-88eb-5e047380ef4f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:59.560147 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-19693cbf-83c2-4c85-88eb-5e047380ef4f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:59.560601 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-19693cbf-83c2-4c85-88eb-5e047380ef4f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:59.561021 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-19693cbf-83c2-4c85-88eb-5e047380ef4f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:59.693926 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-19693cbf-83c2-4c85-88eb-5e047380ef4f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:59.701355 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-19693cbf-83c2-4c85-88eb-5e047380ef4f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987" status: 200 len: 1367 microversion: 2.1 time: 0.156805 Aug 06 14:30:59.701909 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 101/218] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:59 2022] GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:30:59.704195 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-0b6d15ed-76f3-4631-bc9d-eda23244a825 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:59.705015 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-0b6d15ed-76f3-4631-bc9d-eda23244a825 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] [instance: 4a7abdbc-0453-43a8-9668-f1b377162d8f] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:59.711133 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0b6d15ed-76f3-4631-bc9d-eda23244a825 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:59.711680 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0b6d15ed-76f3-4631-bc9d-eda23244a825 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:59.712181 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0b6d15ed-76f3-4631-bc9d-eda23244a825 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:59.712920 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0b6d15ed-76f3-4631-bc9d-eda23244a825 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:59.713458 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0b6d15ed-76f3-4631-bc9d-eda23244a825 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:59.713952 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0b6d15ed-76f3-4631-bc9d-eda23244a825 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:59.775229 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-0b6d15ed-76f3-4631-bc9d-eda23244a825 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de557945688e4d9f944310015bb42163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d02ee1ad57f4d38acf0bc95ab43f614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:59.777323 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-f9fb70a2-4b10-4303-8b6f-2a8a7399e323 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:59.777999 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-f9fb70a2-4b10-4303-8b6f-2a8a7399e323 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:59.782618 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-0b6d15ed-76f3-4631-bc9d-eda23244a825 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] 10.222.0.17 "GET /compute/v2.1/servers/4a7abdbc-0453-43a8-9668-f1b377162d8f" status: 200 len: 1267 microversion: 2.1 time: 0.082670 Aug 06 14:30:59.783255 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 118/219] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:59 2022] GET /compute/v2.1/servers/4a7abdbc-0453-43a8-9668-f1b377162d8f => generated 1267 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:30:59.784060 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f9fb70a2-4b10-4303-8b6f-2a8a7399e323 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:59.784699 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f9fb70a2-4b10-4303-8b6f-2a8a7399e323 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:59.785137 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f9fb70a2-4b10-4303-8b6f-2a8a7399e323 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:59.785855 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f9fb70a2-4b10-4303-8b6f-2a8a7399e323 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:59.786339 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f9fb70a2-4b10-4303-8b6f-2a8a7399e323 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:59.786761 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f9fb70a2-4b10-4303-8b6f-2a8a7399e323 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:59.923414 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-f9fb70a2-4b10-4303-8b6f-2a8a7399e323 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:30:59.931929 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-f9fb70a2-4b10-4303-8b6f-2a8a7399e323 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1322 microversion: 2.1 time: 0.158525 Aug 06 14:30:59.932496 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 102/220] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:30:59 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:30:59.947672 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-0b5d88ae-dc31-4806-a0ab-6ae3ec4bbdd3 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:30:59.948317 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-0b5d88ae-dc31-4806-a0ab-6ae3ec4bbdd3 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:30:59.954123 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0b5d88ae-dc31-4806-a0ab-6ae3ec4bbdd3 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:59.954606 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0b5d88ae-dc31-4806-a0ab-6ae3ec4bbdd3 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:59.955083 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0b5d88ae-dc31-4806-a0ab-6ae3ec4bbdd3 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:30:59.955771 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0b5d88ae-dc31-4806-a0ab-6ae3ec4bbdd3 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:30:59.956227 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0b5d88ae-dc31-4806-a0ab-6ae3ec4bbdd3 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:30:59.956650 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0b5d88ae-dc31-4806-a0ab-6ae3ec4bbdd3 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:00.005506 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-63bf216b-3af9-4dfa-a286-c9c79d6f18de tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:00.006243 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-63bf216b-3af9-4dfa-a286-c9c79d6f18de tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:00.012242 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-63bf216b-3af9-4dfa-a286-c9c79d6f18de tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:00.012724 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-63bf216b-3af9-4dfa-a286-c9c79d6f18de tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:00.013159 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-63bf216b-3af9-4dfa-a286-c9c79d6f18de tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:00.013847 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-63bf216b-3af9-4dfa-a286-c9c79d6f18de tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:00.014303 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-63bf216b-3af9-4dfa-a286-c9c79d6f18de tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:00.014726 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-63bf216b-3af9-4dfa-a286-c9c79d6f18de tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:00.102168 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-0b5d88ae-dc31-4806-a0ab-6ae3ec4bbdd3 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:00.111403 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-0b5d88ae-dc31-4806-a0ab-6ae3ec4bbdd3 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:00.112908 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-0b5d88ae-dc31-4806-a0ab-6ae3ec4bbdd3 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:00.114035 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-0b5d88ae-dc31-4806-a0ab-6ae3ec4bbdd3 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1408 microversion: 2.20 time: 0.170202 Aug 06 14:31:00.114584 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 119/221] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:30:59 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1408 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:31:00.156124 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-63bf216b-3af9-4dfa-a286-c9c79d6f18de tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:00.164670 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-63bf216b-3af9-4dfa-a286-c9c79d6f18de tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1362 microversion: 2.1 time: 0.162978 Aug 06 14:31:00.171023 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 103/222] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:00 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:31:00.303844 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-84ff33c3-4c89-48f8-aeac-98654d6a4b2d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:00.304501 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-84ff33c3-4c89-48f8-aeac-98654d6a4b2d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] [instance: 0604e338-9ab8-40db-a076-0fb13ba92f24] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:00.310700 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-84ff33c3-4c89-48f8-aeac-98654d6a4b2d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:00.311225 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-84ff33c3-4c89-48f8-aeac-98654d6a4b2d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:00.311665 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-84ff33c3-4c89-48f8-aeac-98654d6a4b2d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:00.312400 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-84ff33c3-4c89-48f8-aeac-98654d6a4b2d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:00.312942 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-84ff33c3-4c89-48f8-aeac-98654d6a4b2d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:00.313358 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-84ff33c3-4c89-48f8-aeac-98654d6a4b2d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:00.451422 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-84ff33c3-4c89-48f8-aeac-98654d6a4b2d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1e8506e8b34a8d9c59b4acdbf23bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ead8c81ff3486683d21f671acac6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:00.458758 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-84ff33c3-4c89-48f8-aeac-98654d6a4b2d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] 10.222.0.17 "GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24" status: 200 len: 1314 microversion: 2.1 time: 0.158667 Aug 06 14:31:00.459711 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 120/223] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:00 2022] GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:00.722058 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-cd67c22f-2240-478d-b3ed-fe1cf970ae00 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:00.724328 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-cd67c22f-2240-478d-b3ed-fe1cf970ae00 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6e717f01-c854-444e-9872-51e2c1c78987] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:00.732052 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-cd67c22f-2240-478d-b3ed-fe1cf970ae00 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:00.732778 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-cd67c22f-2240-478d-b3ed-fe1cf970ae00 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:00.733203 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-cd67c22f-2240-478d-b3ed-fe1cf970ae00 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:00.734106 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-cd67c22f-2240-478d-b3ed-fe1cf970ae00 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:00.734936 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-cd67c22f-2240-478d-b3ed-fe1cf970ae00 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:00.735370 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-cd67c22f-2240-478d-b3ed-fe1cf970ae00 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:00.804865 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-1870a865-938e-4e5e-80cc-aafcfd49a461 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:00.805733 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-1870a865-938e-4e5e-80cc-aafcfd49a461 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] [instance: 4a7abdbc-0453-43a8-9668-f1b377162d8f] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:00.813692 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1870a865-938e-4e5e-80cc-aafcfd49a461 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:00.817298 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1870a865-938e-4e5e-80cc-aafcfd49a461 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:00.817916 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1870a865-938e-4e5e-80cc-aafcfd49a461 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:00.818789 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1870a865-938e-4e5e-80cc-aafcfd49a461 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:00.819275 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1870a865-938e-4e5e-80cc-aafcfd49a461 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:00.820250 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1870a865-938e-4e5e-80cc-aafcfd49a461 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:00.853680 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_cell1:SELECT=100 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:31:00.914936 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-1870a865-938e-4e5e-80cc-aafcfd49a461 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de557945688e4d9f944310015bb42163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d02ee1ad57f4d38acf0bc95ab43f614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:00.922756 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-1870a865-938e-4e5e-80cc-aafcfd49a461 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] 10.222.0.17 "GET /compute/v2.1/servers/4a7abdbc-0453-43a8-9668-f1b377162d8f" status: 200 len: 1275 microversion: 2.1 time: 0.122191 Aug 06 14:31:00.927879 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 121/224] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:00 2022] GET /compute/v2.1/servers/4a7abdbc-0453-43a8-9668-f1b377162d8f => generated 1275 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:31:00.941850 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-cd67c22f-2240-478d-b3ed-fe1cf970ae00 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:00.952596 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-cd67c22f-2240-478d-b3ed-fe1cf970ae00 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987" status: 200 len: 1367 microversion: 2.1 time: 0.234718 Aug 06 14:31:00.953347 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 104/225] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:00 2022] GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987 => generated 1367 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:00.956057 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-cafb5ec4-1d8c-4251-a240-5679c5d87d9f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:00.956891 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-cafb5ec4-1d8c-4251-a240-5679c5d87d9f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:00.969863 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-cafb5ec4-1d8c-4251-a240-5679c5d87d9f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:00.970266 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-cafb5ec4-1d8c-4251-a240-5679c5d87d9f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:00.970700 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-cafb5ec4-1d8c-4251-a240-5679c5d87d9f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:00.971898 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-cafb5ec4-1d8c-4251-a240-5679c5d87d9f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:00.972430 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-cafb5ec4-1d8c-4251-a240-5679c5d87d9f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:00.972859 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-cafb5ec4-1d8c-4251-a240-5679c5d87d9f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:01.115850 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-cafb5ec4-1d8c-4251-a240-5679c5d87d9f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:01.123738 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-cafb5ec4-1d8c-4251-a240-5679c5d87d9f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1515 microversion: 2.1 time: 0.175269 Aug 06 14:31:01.124310 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 122/226] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:00 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1515 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:01.139156 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-9ff49a4d-dd8d-4243-ada1-ec5efc129b12 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:01.139761 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-9ff49a4d-dd8d-4243-ada1-ec5efc129b12 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:01.144302 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-54f4b0d1-5003-41eb-919d-a3ffc78c5b72 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:31:01.145678 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9ff49a4d-dd8d-4243-ada1-ec5efc129b12 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:01.146161 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9ff49a4d-dd8d-4243-ada1-ec5efc129b12 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:01.146554 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-54f4b0d1-5003-41eb-919d-a3ffc78c5b72 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:01.146657 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9ff49a4d-dd8d-4243-ada1-ec5efc129b12 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:01.147292 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9ff49a4d-dd8d-4243-ada1-ec5efc129b12 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:01.147795 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9ff49a4d-dd8d-4243-ada1-ec5efc129b12 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:01.148201 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9ff49a4d-dd8d-4243-ada1-ec5efc129b12 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:01.152337 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-54f4b0d1-5003-41eb-919d-a3ffc78c5b72 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:01.152817 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-54f4b0d1-5003-41eb-919d-a3ffc78c5b72 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:01.153247 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-54f4b0d1-5003-41eb-919d-a3ffc78c5b72 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:01.153926 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-54f4b0d1-5003-41eb-919d-a3ffc78c5b72 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:01.154438 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-54f4b0d1-5003-41eb-919d-a3ffc78c5b72 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:01.154894 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-54f4b0d1-5003-41eb-919d-a3ffc78c5b72 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:01.223308 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.objects.instance [None req-54f4b0d1-5003-41eb-919d-a3ffc78c5b72 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lazy-loading 'flavor' on Instance uuid 02ac0364-de9e-4a71-8210-dc3fcd23a33e {{(pid=117837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 14:31:01.373423 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-54f4b0d1-5003-41eb-919d-a3ffc78c5b72 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "POST /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e/action" status: 200 len: 32 microversion: 2.1 time: 0.232413 Aug 06 14:31:01.378207 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 123/227] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Aug 6 14:31:01 2022] POST /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e/action => generated 32 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 06 14:31:01.379680 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-9ff49a4d-dd8d-4243-ada1-ec5efc129b12 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:01.383875 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-77726451-51c8-47a7-82c7-37bbea7c8611 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:01.384593 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-77726451-51c8-47a7-82c7-37bbea7c8611 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:01.389220 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-9ff49a4d-dd8d-4243-ada1-ec5efc129b12 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:01.391212 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-9ff49a4d-dd8d-4243-ada1-ec5efc129b12 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:01.391632 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-77726451-51c8-47a7-82c7-37bbea7c8611 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:01.392128 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-77726451-51c8-47a7-82c7-37bbea7c8611 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:01.392700 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-77726451-51c8-47a7-82c7-37bbea7c8611 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:01.393237 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-9ff49a4d-dd8d-4243-ada1-ec5efc129b12 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1408 microversion: 2.20 time: 0.257757 Aug 06 14:31:01.393395 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-77726451-51c8-47a7-82c7-37bbea7c8611 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:01.393849 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-77726451-51c8-47a7-82c7-37bbea7c8611 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:01.394275 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-77726451-51c8-47a7-82c7-37bbea7c8611 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:01.394747 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 105/228] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:31:01 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1408 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 14:31:01.414644 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-2f37d62b-65d5-4f48-b6f5-8ffb2b5641d7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:01.415584 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-2f37d62b-65d5-4f48-b6f5-8ffb2b5641d7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:01.422475 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2f37d62b-65d5-4f48-b6f5-8ffb2b5641d7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:01.423283 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2f37d62b-65d5-4f48-b6f5-8ffb2b5641d7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:01.423905 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2f37d62b-65d5-4f48-b6f5-8ffb2b5641d7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:01.424663 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2f37d62b-65d5-4f48-b6f5-8ffb2b5641d7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:01.425102 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2f37d62b-65d5-4f48-b6f5-8ffb2b5641d7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:01.425568 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2f37d62b-65d5-4f48-b6f5-8ffb2b5641d7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:01.540564 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-77726451-51c8-47a7-82c7-37bbea7c8611 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:01.548394 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-77726451-51c8-47a7-82c7-37bbea7c8611 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1362 microversion: 2.1 time: 0.172754 Aug 06 14:31:01.549220 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 124/229] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:01 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:01.566096 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-749136c1-c27c-4c6f-82e3-b23159ca92a2 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:01.566706 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-749136c1-c27c-4c6f-82e3-b23159ca92a2 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] [instance: 0604e338-9ab8-40db-a076-0fb13ba92f24] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:01.573059 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-749136c1-c27c-4c6f-82e3-b23159ca92a2 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:01.573541 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-749136c1-c27c-4c6f-82e3-b23159ca92a2 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:01.573977 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-749136c1-c27c-4c6f-82e3-b23159ca92a2 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:01.574671 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-749136c1-c27c-4c6f-82e3-b23159ca92a2 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:01.575154 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-749136c1-c27c-4c6f-82e3-b23159ca92a2 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:01.575582 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-749136c1-c27c-4c6f-82e3-b23159ca92a2 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:01.579290 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-2f37d62b-65d5-4f48-b6f5-8ffb2b5641d7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:01.594949 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-2f37d62b-65d5-4f48-b6f5-8ffb2b5641d7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1521 microversion: 2.1 time: 0.186531 Aug 06 14:31:01.595699 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 106/230] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:01 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:01.715828 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-749136c1-c27c-4c6f-82e3-b23159ca92a2 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1e8506e8b34a8d9c59b4acdbf23bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ead8c81ff3486683d21f671acac6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:01.723354 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-749136c1-c27c-4c6f-82e3-b23159ca92a2 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] 10.222.0.17 "GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24" status: 200 len: 1314 microversion: 2.1 time: 0.160887 Aug 06 14:31:01.723826 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 125/231] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:01 2022] GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:01.944312 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-9b7dadf6-ccb0-4336-b295-a1c9fa730de8 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:01.945547 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-9b7dadf6-ccb0-4336-b295-a1c9fa730de8 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] [instance: 4a7abdbc-0453-43a8-9668-f1b377162d8f] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:01.952426 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9b7dadf6-ccb0-4336-b295-a1c9fa730de8 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:01.953067 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9b7dadf6-ccb0-4336-b295-a1c9fa730de8 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:01.953626 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9b7dadf6-ccb0-4336-b295-a1c9fa730de8 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:01.954433 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9b7dadf6-ccb0-4336-b295-a1c9fa730de8 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:01.954914 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9b7dadf6-ccb0-4336-b295-a1c9fa730de8 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:01.955464 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9b7dadf6-ccb0-4336-b295-a1c9fa730de8 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:01.973519 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-e8a13b58-6911-40bb-b9cb-264f27636098 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:01.974044 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-e8a13b58-6911-40bb-b9cb-264f27636098 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6e717f01-c854-444e-9872-51e2c1c78987] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:01.980476 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e8a13b58-6911-40bb-b9cb-264f27636098 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:01.980968 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e8a13b58-6911-40bb-b9cb-264f27636098 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:01.981407 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e8a13b58-6911-40bb-b9cb-264f27636098 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:01.982102 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e8a13b58-6911-40bb-b9cb-264f27636098 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:01.982561 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e8a13b58-6911-40bb-b9cb-264f27636098 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:01.983019 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e8a13b58-6911-40bb-b9cb-264f27636098 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:02.019372 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-9b7dadf6-ccb0-4336-b295-a1c9fa730de8 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de557945688e4d9f944310015bb42163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d02ee1ad57f4d38acf0bc95ab43f614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:02.027669 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-9b7dadf6-ccb0-4336-b295-a1c9fa730de8 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] 10.222.0.17 "GET /compute/v2.1/servers/4a7abdbc-0453-43a8-9668-f1b377162d8f" status: 200 len: 1275 microversion: 2.1 time: 0.087072 Aug 06 14:31:02.028246 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 107/232] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:01 2022] GET /compute/v2.1/servers/4a7abdbc-0453-43a8-9668-f1b377162d8f => generated 1275 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:02.112448 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-e8a13b58-6911-40bb-b9cb-264f27636098 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:02.144508 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-e8a13b58-6911-40bb-b9cb-264f27636098 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987" status: 200 len: 1367 microversion: 2.1 time: 0.172093 Aug 06 14:31:02.146579 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 126/233] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:01 2022] GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987 => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:31:02.420652 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-7e1e83b1-c0ee-4c68-80b8-cc21781ec7f0 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:02.421373 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-7e1e83b1-c0ee-4c68-80b8-cc21781ec7f0 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:02.427999 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7e1e83b1-c0ee-4c68-80b8-cc21781ec7f0 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:02.428649 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7e1e83b1-c0ee-4c68-80b8-cc21781ec7f0 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:02.430063 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7e1e83b1-c0ee-4c68-80b8-cc21781ec7f0 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:02.431070 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7e1e83b1-c0ee-4c68-80b8-cc21781ec7f0 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:02.431608 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7e1e83b1-c0ee-4c68-80b8-cc21781ec7f0 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:02.432274 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7e1e83b1-c0ee-4c68-80b8-cc21781ec7f0 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:02.448887 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_cell1:SELECT=100 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:31:02.570791 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-f0999492-ad7d-4cfd-95d9-1b87dc38698d tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:02.572431 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-f0999492-ad7d-4cfd-95d9-1b87dc38698d tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:02.579604 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-7e1e83b1-c0ee-4c68-80b8-cc21781ec7f0 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:02.581472 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f0999492-ad7d-4cfd-95d9-1b87dc38698d tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:02.582382 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f0999492-ad7d-4cfd-95d9-1b87dc38698d tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:02.582833 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f0999492-ad7d-4cfd-95d9-1b87dc38698d tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:02.583567 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f0999492-ad7d-4cfd-95d9-1b87dc38698d tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:02.584024 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f0999492-ad7d-4cfd-95d9-1b87dc38698d tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:02.584453 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f0999492-ad7d-4cfd-95d9-1b87dc38698d tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:02.588666 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-7e1e83b1-c0ee-4c68-80b8-cc21781ec7f0 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:02.590173 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-7e1e83b1-c0ee-4c68-80b8-cc21781ec7f0 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:02.591562 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-7e1e83b1-c0ee-4c68-80b8-cc21781ec7f0 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1601 microversion: 2.20 time: 0.174852 Aug 06 14:31:02.609918 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 108/234] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:31:02 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1601 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:31:02.616005 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-66f961aa-b191-411c-b5a8-75553f21fe45 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:02.617021 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-66f961aa-b191-411c-b5a8-75553f21fe45 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:02.623856 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-66f961aa-b191-411c-b5a8-75553f21fe45 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:02.624579 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-66f961aa-b191-411c-b5a8-75553f21fe45 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:02.625011 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-66f961aa-b191-411c-b5a8-75553f21fe45 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:02.625709 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-66f961aa-b191-411c-b5a8-75553f21fe45 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:02.626158 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-66f961aa-b191-411c-b5a8-75553f21fe45 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:02.626576 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-66f961aa-b191-411c-b5a8-75553f21fe45 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:02.762181 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-f0999492-ad7d-4cfd-95d9-1b87dc38698d tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:02.771420 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-66f961aa-b191-411c-b5a8-75553f21fe45 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.160044 Aug 06 14:31:02.775079 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 109/235] 10.222.0.17 () {60 vars in 1316 bytes} [Sat Aug 6 14:31:02 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8/os-interface => generated 285 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 14:31:02.780625 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-3e65b9bc-7d02-41dd-adeb-fad7a36c9444 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:02.781429 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-3e65b9bc-7d02-41dd-adeb-fad7a36c9444 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:02.785397 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-f0999492-ad7d-4cfd-95d9-1b87dc38698d tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1362 microversion: 2.1 time: 0.218878 Aug 06 14:31:02.787224 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 127/236] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:02 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1362 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:02.789480 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3e65b9bc-7d02-41dd-adeb-fad7a36c9444 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:02.790296 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3e65b9bc-7d02-41dd-adeb-fad7a36c9444 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:02.790734 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3e65b9bc-7d02-41dd-adeb-fad7a36c9444 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:02.791851 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3e65b9bc-7d02-41dd-adeb-fad7a36c9444 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:02.792459 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3e65b9bc-7d02-41dd-adeb-fad7a36c9444 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:02.793034 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3e65b9bc-7d02-41dd-adeb-fad7a36c9444 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:02.802859 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-306e5adb-2e69-4f6e-a156-89959deb4e03 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:02.803841 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-306e5adb-2e69-4f6e-a156-89959deb4e03 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] [instance: 0604e338-9ab8-40db-a076-0fb13ba92f24] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:02.810776 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-306e5adb-2e69-4f6e-a156-89959deb4e03 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:02.811569 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-306e5adb-2e69-4f6e-a156-89959deb4e03 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:02.812162 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-306e5adb-2e69-4f6e-a156-89959deb4e03 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:02.813017 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-306e5adb-2e69-4f6e-a156-89959deb4e03 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:02.813619 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-306e5adb-2e69-4f6e-a156-89959deb4e03 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:02.814189 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-306e5adb-2e69-4f6e-a156-89959deb4e03 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:02.988582 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-3e65b9bc-7d02-41dd-adeb-fad7a36c9444 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:02.997461 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-3e65b9bc-7d02-41dd-adeb-fad7a36c9444 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1521 microversion: 2.1 time: 0.221078 Aug 06 14:31:02.998580 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 110/237] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:02 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:03.049101 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-44b93051-9144-4451-811f-1d4d3bca9d26 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:03.050161 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-44b93051-9144-4451-811f-1d4d3bca9d26 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] [instance: 4a7abdbc-0453-43a8-9668-f1b377162d8f] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:03.058757 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-44b93051-9144-4451-811f-1d4d3bca9d26 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:03.059850 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-44b93051-9144-4451-811f-1d4d3bca9d26 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:03.060552 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-44b93051-9144-4451-811f-1d4d3bca9d26 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:03.061620 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-44b93051-9144-4451-811f-1d4d3bca9d26 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:03.063204 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-44b93051-9144-4451-811f-1d4d3bca9d26 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:03.063836 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-44b93051-9144-4451-811f-1d4d3bca9d26 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:03.152488 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-44b93051-9144-4451-811f-1d4d3bca9d26 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de557945688e4d9f944310015bb42163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d02ee1ad57f4d38acf0bc95ab43f614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:03.160373 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-44b93051-9144-4451-811f-1d4d3bca9d26 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] 10.222.0.17 "GET /compute/v2.1/servers/4a7abdbc-0453-43a8-9668-f1b377162d8f" status: 200 len: 1273 microversion: 2.1 time: 0.116019 Aug 06 14:31:03.160946 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 111/238] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:03 2022] GET /compute/v2.1/servers/4a7abdbc-0453-43a8-9668-f1b377162d8f => generated 1273 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:31:03.180990 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [req-e38657ea-5e9f-4342-b788-1ece07b725da req-bacd444f-961d-4517-8591-d7c8439181a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0604e338-9ab8-40db-a076-0fb13ba92f24", "name": "network-vif-plugged", "status": "completed", "tag": "7957f136-33e5-4e1d-b200-e7d9374401f8"}]} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:31:03.195090 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-e38657ea-5e9f-4342-b788-1ece07b725da req-bacd444f-961d-4517-8591-d7c8439181a0 service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:03.195843 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-e38657ea-5e9f-4342-b788-1ece07b725da req-bacd444f-961d-4517-8591-d7c8439181a0 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:03.196456 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-e38657ea-5e9f-4342-b788-1ece07b725da req-bacd444f-961d-4517-8591-d7c8439181a0 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:03.208311 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-306e5adb-2e69-4f6e-a156-89959deb4e03 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1e8506e8b34a8d9c59b4acdbf23bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ead8c81ff3486683d21f671acac6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:03.209753 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.compute.server_external_events [req-e38657ea-5e9f-4342-b788-1ece07b725da req-bacd444f-961d-4517-8591-d7c8439181a0 service nova] Creating event network-vif-plugged:7957f136-33e5-4e1d-b200-e7d9374401f8 for instance 0604e338-9ab8-40db-a076-0fb13ba92f24 on hv-cinder-85199 Aug 06 14:31:03.215650 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [req-e38657ea-5e9f-4342-b788-1ece07b725da req-bacd444f-961d-4517-8591-d7c8439181a0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053405 Aug 06 14:31:03.216494 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 112/239] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:31:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:31:03.217874 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-306e5adb-2e69-4f6e-a156-89959deb4e03 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] 10.222.0.17 "GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24" status: 200 len: 1314 microversion: 2.1 time: 0.429433 Aug 06 14:31:03.218743 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 128/240] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:02 2022] GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24 => generated 1314 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:03.231786 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-44dc2e8c-ab30-46f9-a3a7-71d2facffa8b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:03.232741 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-44dc2e8c-ab30-46f9-a3a7-71d2facffa8b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6e717f01-c854-444e-9872-51e2c1c78987] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:03.243532 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-44dc2e8c-ab30-46f9-a3a7-71d2facffa8b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:03.245049 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-44dc2e8c-ab30-46f9-a3a7-71d2facffa8b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:03.245696 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-44dc2e8c-ab30-46f9-a3a7-71d2facffa8b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:03.247032 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-44dc2e8c-ab30-46f9-a3a7-71d2facffa8b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:03.247699 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-44dc2e8c-ab30-46f9-a3a7-71d2facffa8b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:03.248407 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-44dc2e8c-ab30-46f9-a3a7-71d2facffa8b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:03.460526 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-44dc2e8c-ab30-46f9-a3a7-71d2facffa8b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:03.472077 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-44dc2e8c-ab30-46f9-a3a7-71d2facffa8b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987" status: 200 len: 1367 microversion: 2.1 time: 0.247826 Aug 06 14:31:03.473393 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 113/241] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:03 2022] GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987 => generated 1367 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:03.807443 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-65aa1272-e9d1-49eb-bcad-9e839674ba01 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:03.808348 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-65aa1272-e9d1-49eb-bcad-9e839674ba01 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:03.815972 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-65aa1272-e9d1-49eb-bcad-9e839674ba01 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:03.816487 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-65aa1272-e9d1-49eb-bcad-9e839674ba01 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:03.817024 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-65aa1272-e9d1-49eb-bcad-9e839674ba01 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:03.817828 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-65aa1272-e9d1-49eb-bcad-9e839674ba01 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:03.818489 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-65aa1272-e9d1-49eb-bcad-9e839674ba01 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:03.819266 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-65aa1272-e9d1-49eb-bcad-9e839674ba01 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:04.019633 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-4b41fadb-f624-4159-baee-05d0109b245c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:04.020245 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-4b41fadb-f624-4159-baee-05d0109b245c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:04.028190 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4b41fadb-f624-4159-baee-05d0109b245c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:04.028865 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4b41fadb-f624-4159-baee-05d0109b245c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:04.029303 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4b41fadb-f624-4159-baee-05d0109b245c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:04.030183 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4b41fadb-f624-4159-baee-05d0109b245c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:04.030764 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4b41fadb-f624-4159-baee-05d0109b245c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:04.031382 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4b41fadb-f624-4159-baee-05d0109b245c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:04.179875 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-65aa1272-e9d1-49eb-bcad-9e839674ba01 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:04.202706 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-4b41fadb-f624-4159-baee-05d0109b245c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:04.214072 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-4b41fadb-f624-4159-baee-05d0109b245c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1521 microversion: 2.1 time: 0.198934 Aug 06 14:31:04.215838 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-65aa1272-e9d1-49eb-bcad-9e839674ba01 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1362 microversion: 2.1 time: 0.412787 Aug 06 14:31:04.217404 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 114/242] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:04 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:31:04.218851 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 129/243] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:03 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1362 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:04.239551 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-b30f251e-3ccd-4b7f-9548-6020f157fa2e tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:04.239952 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-6498760d-5407-4e21-8ec3-13d575119aa9 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:04.241123 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-b30f251e-3ccd-4b7f-9548-6020f157fa2e tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] [instance: 4a7abdbc-0453-43a8-9668-f1b377162d8f] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:04.241749 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-6498760d-5407-4e21-8ec3-13d575119aa9 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] [instance: 0604e338-9ab8-40db-a076-0fb13ba92f24] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:04.245246 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:31:04.248666 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b30f251e-3ccd-4b7f-9548-6020f157fa2e tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:04.249311 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b30f251e-3ccd-4b7f-9548-6020f157fa2e tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:04.249811 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b30f251e-3ccd-4b7f-9548-6020f157fa2e tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:04.250620 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b30f251e-3ccd-4b7f-9548-6020f157fa2e tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:04.252414 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b30f251e-3ccd-4b7f-9548-6020f157fa2e tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:04.252569 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6498760d-5407-4e21-8ec3-13d575119aa9 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:04.252951 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b30f251e-3ccd-4b7f-9548-6020f157fa2e tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:04.253590 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6498760d-5407-4e21-8ec3-13d575119aa9 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:04.254217 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6498760d-5407-4e21-8ec3-13d575119aa9 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:04.255170 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6498760d-5407-4e21-8ec3-13d575119aa9 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:04.255815 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6498760d-5407-4e21-8ec3-13d575119aa9 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:04.256838 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6498760d-5407-4e21-8ec3-13d575119aa9 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:04.325480 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-b30f251e-3ccd-4b7f-9548-6020f157fa2e tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de557945688e4d9f944310015bb42163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d02ee1ad57f4d38acf0bc95ab43f614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:04.332872 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-b30f251e-3ccd-4b7f-9548-6020f157fa2e tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] 10.222.0.17 "GET /compute/v2.1/servers/4a7abdbc-0453-43a8-9668-f1b377162d8f" status: 200 len: 1273 microversion: 2.1 time: 0.114269 Aug 06 14:31:04.346969 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 115/244] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:04 2022] GET /compute/v2.1/servers/4a7abdbc-0453-43a8-9668-f1b377162d8f => generated 1273 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:04.493077 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-046a36d5-c9ee-4a7f-a342-075fc5f8e948 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:04.493688 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-046a36d5-c9ee-4a7f-a342-075fc5f8e948 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6e717f01-c854-444e-9872-51e2c1c78987] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:04.499801 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-046a36d5-c9ee-4a7f-a342-075fc5f8e948 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:04.500545 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-046a36d5-c9ee-4a7f-a342-075fc5f8e948 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:04.501298 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-046a36d5-c9ee-4a7f-a342-075fc5f8e948 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:04.502281 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-046a36d5-c9ee-4a7f-a342-075fc5f8e948 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:04.504638 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-046a36d5-c9ee-4a7f-a342-075fc5f8e948 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:04.505461 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-046a36d5-c9ee-4a7f-a342-075fc5f8e948 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:04.536864 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-6498760d-5407-4e21-8ec3-13d575119aa9 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1e8506e8b34a8d9c59b4acdbf23bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ead8c81ff3486683d21f671acac6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:04.545347 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-6498760d-5407-4e21-8ec3-13d575119aa9 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] 10.222.0.17 "GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24" status: 200 len: 1314 microversion: 2.1 time: 0.309532 Aug 06 14:31:04.546241 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 130/245] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:04 2022] GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24 => generated 1314 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:31:04.567562 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [req-971d8dd4-4de5-4a3f-8d17-b4cfd97bb603 req-56b30a3b-3169-4575-8764-71f2bb0f62e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cf29bae-83f8-43e3-9118-0fea5a019ff8", "tag": "988ecdda-956b-4c8b-8ee4-231ef3ed0bb2"}]} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:31:04.579927 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-971d8dd4-4de5-4a3f-8d17-b4cfd97bb603 req-56b30a3b-3169-4575-8764-71f2bb0f62e8 service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:04.580776 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-971d8dd4-4de5-4a3f-8d17-b4cfd97bb603 req-56b30a3b-3169-4575-8764-71f2bb0f62e8 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:04.581435 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-971d8dd4-4de5-4a3f-8d17-b4cfd97bb603 req-56b30a3b-3169-4575-8764-71f2bb0f62e8 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:04.593845 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.compute.server_external_events [req-971d8dd4-4de5-4a3f-8d17-b4cfd97bb603 req-56b30a3b-3169-4575-8764-71f2bb0f62e8 service nova] Creating event network-changed:988ecdda-956b-4c8b-8ee4-231ef3ed0bb2 for instance 5cf29bae-83f8-43e3-9118-0fea5a019ff8 on hv-cinder-85199 Aug 06 14:31:04.600454 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [req-971d8dd4-4de5-4a3f-8d17-b4cfd97bb603 req-56b30a3b-3169-4575-8764-71f2bb0f62e8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036406 Aug 06 14:31:04.603189 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 131/246] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:31:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 14:31:04.689486 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-046a36d5-c9ee-4a7f-a342-075fc5f8e948 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:04.698980 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-046a36d5-c9ee-4a7f-a342-075fc5f8e948 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987" status: 200 len: 1367 microversion: 2.1 time: 0.209820 Aug 06 14:31:04.699862 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 116/247] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:04 2022] GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987 => generated 1367 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:31:05.237227 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-5aca60c0-de12-4be1-9ff3-852f90ebb272 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:05.238531 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-5aca60c0-de12-4be1-9ff3-852f90ebb272 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:05.243013 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-24f13f06-0e18-4a0e-8f1a-09466b558142 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:05.244230 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-24f13f06-0e18-4a0e-8f1a-09466b558142 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:05.246489 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5aca60c0-de12-4be1-9ff3-852f90ebb272 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:05.247210 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5aca60c0-de12-4be1-9ff3-852f90ebb272 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:05.247819 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5aca60c0-de12-4be1-9ff3-852f90ebb272 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:05.248683 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5aca60c0-de12-4be1-9ff3-852f90ebb272 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:05.249325 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5aca60c0-de12-4be1-9ff3-852f90ebb272 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:05.249894 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5aca60c0-de12-4be1-9ff3-852f90ebb272 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:05.254331 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-24f13f06-0e18-4a0e-8f1a-09466b558142 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:05.255210 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-24f13f06-0e18-4a0e-8f1a-09466b558142 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:05.255776 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-24f13f06-0e18-4a0e-8f1a-09466b558142 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:05.256626 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-24f13f06-0e18-4a0e-8f1a-09466b558142 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:05.257285 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-24f13f06-0e18-4a0e-8f1a-09466b558142 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:05.258234 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-24f13f06-0e18-4a0e-8f1a-09466b558142 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:05.443814 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-5aca60c0-de12-4be1-9ff3-852f90ebb272 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:05.458304 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-5aca60c0-de12-4be1-9ff3-852f90ebb272 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1521 microversion: 2.1 time: 0.224765 Aug 06 14:31:05.461720 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 117/248] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:05 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:31:05.466279 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-24f13f06-0e18-4a0e-8f1a-09466b558142 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:05.469802 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-80aa1653-cd14-44d1-a9b9-76862e8ade4a tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:05.474500 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-80aa1653-cd14-44d1-a9b9-76862e8ade4a tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] [instance: 4a7abdbc-0453-43a8-9668-f1b377162d8f] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:05.477614 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-24f13f06-0e18-4a0e-8f1a-09466b558142 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1362 microversion: 2.1 time: 0.240742 Aug 06 14:31:05.478233 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 132/249] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:05 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1362 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:05.496491 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-80aa1653-cd14-44d1-a9b9-76862e8ade4a tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:05.497212 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-80aa1653-cd14-44d1-a9b9-76862e8ade4a tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:05.497834 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-80aa1653-cd14-44d1-a9b9-76862e8ade4a tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:05.499853 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-80aa1653-cd14-44d1-a9b9-76862e8ade4a tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:05.500406 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-80aa1653-cd14-44d1-a9b9-76862e8ade4a tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:05.500913 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-80aa1653-cd14-44d1-a9b9-76862e8ade4a tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:05.568550 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-1278ed81-8bb8-463d-b0c3-fa753d0b66ff tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:05.569150 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-1278ed81-8bb8-463d-b0c3-fa753d0b66ff tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] [instance: 0604e338-9ab8-40db-a076-0fb13ba92f24] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:05.574494 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-80aa1653-cd14-44d1-a9b9-76862e8ade4a tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de557945688e4d9f944310015bb42163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d02ee1ad57f4d38acf0bc95ab43f614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:05.575575 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1278ed81-8bb8-463d-b0c3-fa753d0b66ff tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:05.576064 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1278ed81-8bb8-463d-b0c3-fa753d0b66ff tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:05.576502 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1278ed81-8bb8-463d-b0c3-fa753d0b66ff tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:05.577197 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1278ed81-8bb8-463d-b0c3-fa753d0b66ff tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:05.577651 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1278ed81-8bb8-463d-b0c3-fa753d0b66ff tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:05.578078 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1278ed81-8bb8-463d-b0c3-fa753d0b66ff tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:05.582123 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-80aa1653-cd14-44d1-a9b9-76862e8ade4a tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] 10.222.0.17 "GET /compute/v2.1/servers/4a7abdbc-0453-43a8-9668-f1b377162d8f" status: 200 len: 1273 microversion: 2.1 time: 0.119348 Aug 06 14:31:05.582962 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 118/250] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:05 2022] GET /compute/v2.1/servers/4a7abdbc-0453-43a8-9668-f1b377162d8f => generated 1273 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:05.723203 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-f7e222a4-cc5f-40bb-9ce3-a69bfe2423d3 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:05.724146 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-f7e222a4-cc5f-40bb-9ce3-a69bfe2423d3 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6e717f01-c854-444e-9872-51e2c1c78987] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:05.731452 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f7e222a4-cc5f-40bb-9ce3-a69bfe2423d3 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:05.732156 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f7e222a4-cc5f-40bb-9ce3-a69bfe2423d3 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:05.732755 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f7e222a4-cc5f-40bb-9ce3-a69bfe2423d3 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:05.733457 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f7e222a4-cc5f-40bb-9ce3-a69bfe2423d3 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:05.733964 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f7e222a4-cc5f-40bb-9ce3-a69bfe2423d3 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:05.734387 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f7e222a4-cc5f-40bb-9ce3-a69bfe2423d3 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:05.762968 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-1278ed81-8bb8-463d-b0c3-fa753d0b66ff tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1e8506e8b34a8d9c59b4acdbf23bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ead8c81ff3486683d21f671acac6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:05.774410 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-1278ed81-8bb8-463d-b0c3-fa753d0b66ff tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] 10.222.0.17 "GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24" status: 200 len: 1314 microversion: 2.1 time: 0.209401 Aug 06 14:31:05.775422 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 133/251] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:05 2022] GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24 => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:31:05.903868 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-f7e222a4-cc5f-40bb-9ce3-a69bfe2423d3 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:05.911617 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-f7e222a4-cc5f-40bb-9ce3-a69bfe2423d3 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987" status: 200 len: 1367 microversion: 2.1 time: 0.195477 Aug 06 14:31:05.913526 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 119/252] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:05 2022] GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987 => generated 1367 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:31:06.483226 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-cf016fc7-c568-410c-ba14-e0490e80ce08 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:06.483768 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-cf016fc7-c568-410c-ba14-e0490e80ce08 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:06.492838 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-cf016fc7-c568-410c-ba14-e0490e80ce08 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:06.495929 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-cf016fc7-c568-410c-ba14-e0490e80ce08 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:06.496379 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-cf016fc7-c568-410c-ba14-e0490e80ce08 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:06.497107 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-cf016fc7-c568-410c-ba14-e0490e80ce08 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:06.497566 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-cf016fc7-c568-410c-ba14-e0490e80ce08 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:06.497991 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-cf016fc7-c568-410c-ba14-e0490e80ce08 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:06.498099 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-7436a47b-1afc-4003-8ffd-c1bb47a36018 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:06.498696 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-7436a47b-1afc-4003-8ffd-c1bb47a36018 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:06.511985 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7436a47b-1afc-4003-8ffd-c1bb47a36018 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:06.512484 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7436a47b-1afc-4003-8ffd-c1bb47a36018 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:06.512926 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7436a47b-1afc-4003-8ffd-c1bb47a36018 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:06.513649 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7436a47b-1afc-4003-8ffd-c1bb47a36018 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:06.514089 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7436a47b-1afc-4003-8ffd-c1bb47a36018 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:06.514518 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7436a47b-1afc-4003-8ffd-c1bb47a36018 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:06.796837 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-7436a47b-1afc-4003-8ffd-c1bb47a36018 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:06.804664 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-7436a47b-1afc-4003-8ffd-c1bb47a36018 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1362 microversion: 2.1 time: 0.310137 Aug 06 14:31:06.806089 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 120/253] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:06 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1362 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:06.812550 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-e92f5b4a-d2dc-404a-9a51-6774c49a72fd tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:06.813451 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-e92f5b4a-d2dc-404a-9a51-6774c49a72fd tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] [instance: 4a7abdbc-0453-43a8-9668-f1b377162d8f] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:06.820978 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e92f5b4a-d2dc-404a-9a51-6774c49a72fd tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:06.821773 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e92f5b4a-d2dc-404a-9a51-6774c49a72fd tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:06.823885 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e92f5b4a-d2dc-404a-9a51-6774c49a72fd tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:06.824608 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e92f5b4a-d2dc-404a-9a51-6774c49a72fd tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:06.825764 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e92f5b4a-d2dc-404a-9a51-6774c49a72fd tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:06.826206 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e92f5b4a-d2dc-404a-9a51-6774c49a72fd tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:06.873998 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-cf016fc7-c568-410c-ba14-e0490e80ce08 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:06.883407 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-cf016fc7-c568-410c-ba14-e0490e80ce08 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1521 microversion: 2.1 time: 0.402680 Aug 06 14:31:06.887780 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 134/254] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:06 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1521 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:06.894800 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-7eb12117-6092-48e4-b267-6451984614e1 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:06.896528 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-7eb12117-6092-48e4-b267-6451984614e1 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] [instance: 0604e338-9ab8-40db-a076-0fb13ba92f24] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:06.910078 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7eb12117-6092-48e4-b267-6451984614e1 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:06.910621 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7eb12117-6092-48e4-b267-6451984614e1 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:06.911128 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7eb12117-6092-48e4-b267-6451984614e1 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:06.911954 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7eb12117-6092-48e4-b267-6451984614e1 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:06.912422 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7eb12117-6092-48e4-b267-6451984614e1 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:06.915632 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7eb12117-6092-48e4-b267-6451984614e1 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:06.934636 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-e92f5b4a-d2dc-404a-9a51-6774c49a72fd tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de557945688e4d9f944310015bb42163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d02ee1ad57f4d38acf0bc95ab43f614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:06.953125 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-e92f5b4a-d2dc-404a-9a51-6774c49a72fd tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] 10.222.0.17 "GET /compute/v2.1/servers/4a7abdbc-0453-43a8-9668-f1b377162d8f" status: 200 len: 1273 microversion: 2.1 time: 0.144941 Aug 06 14:31:06.955344 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 121/255] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:06 2022] GET /compute/v2.1/servers/4a7abdbc-0453-43a8-9668-f1b377162d8f => generated 1273 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:06.961716 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-86e2ad85-27c4-4a0b-943d-50398c1ee33b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:06.963080 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-86e2ad85-27c4-4a0b-943d-50398c1ee33b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6e717f01-c854-444e-9872-51e2c1c78987] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:06.971198 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-86e2ad85-27c4-4a0b-943d-50398c1ee33b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:06.972323 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-86e2ad85-27c4-4a0b-943d-50398c1ee33b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:06.973066 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-86e2ad85-27c4-4a0b-943d-50398c1ee33b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:06.974091 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-86e2ad85-27c4-4a0b-943d-50398c1ee33b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:06.974624 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-86e2ad85-27c4-4a0b-943d-50398c1ee33b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:06.975252 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-86e2ad85-27c4-4a0b-943d-50398c1ee33b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:07.188858 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-7eb12117-6092-48e4-b267-6451984614e1 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1e8506e8b34a8d9c59b4acdbf23bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ead8c81ff3486683d21f671acac6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:07.201494 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-7eb12117-6092-48e4-b267-6451984614e1 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] 10.222.0.17 "GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24" status: 200 len: 1314 microversion: 2.1 time: 0.312417 Aug 06 14:31:07.204209 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 135/256] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:06 2022] GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24 => generated 1314 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:07.316685 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-86e2ad85-27c4-4a0b-943d-50398c1ee33b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:07.328789 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-86e2ad85-27c4-4a0b-943d-50398c1ee33b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987" status: 200 len: 1367 microversion: 2.1 time: 0.371561 Aug 06 14:31:07.336001 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 122/257] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:06 2022] GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987 => generated 1367 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:07.831679 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-16a27681-b35d-4f02-aff0-29d5a2f27acb tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:07.832985 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-16a27681-b35d-4f02-aff0-29d5a2f27acb tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:07.835892 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_cell0:SELECT=2 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:31:07.837395 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_cell0:SELECT=6 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:31:07.845452 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-16a27681-b35d-4f02-aff0-29d5a2f27acb tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:07.846323 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-16a27681-b35d-4f02-aff0-29d5a2f27acb tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:07.847024 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-16a27681-b35d-4f02-aff0-29d5a2f27acb tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:07.850791 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-16a27681-b35d-4f02-aff0-29d5a2f27acb tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:07.852206 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-16a27681-b35d-4f02-aff0-29d5a2f27acb tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:07.852933 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-16a27681-b35d-4f02-aff0-29d5a2f27acb tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:07.907163 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_cell0:SELECT=2 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:31:07.912284 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-bebc27a3-bbd7-4c97-b8f1-a6043b1526b4 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:07.913090 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-bebc27a3-bbd7-4c97-b8f1-a6043b1526b4 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:07.920155 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-bebc27a3-bbd7-4c97-b8f1-a6043b1526b4 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:07.920880 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-bebc27a3-bbd7-4c97-b8f1-a6043b1526b4 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:07.921472 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-bebc27a3-bbd7-4c97-b8f1-a6043b1526b4 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:07.922343 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-bebc27a3-bbd7-4c97-b8f1-a6043b1526b4 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:07.922967 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-bebc27a3-bbd7-4c97-b8f1-a6043b1526b4 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:07.923537 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-bebc27a3-bbd7-4c97-b8f1-a6043b1526b4 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:08.016626 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-16a27681-b35d-4f02-aff0-29d5a2f27acb tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:08.020053 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:31:08.026157 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-16a27681-b35d-4f02-aff0-29d5a2f27acb tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1362 microversion: 2.1 time: 0.201964 Aug 06 14:31:08.026723 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 136/258] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:07 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1362 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:08.031197 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-c83a03f0-58c7-401d-b0e5-1a93940105a7 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:08.031808 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-c83a03f0-58c7-401d-b0e5-1a93940105a7 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] [instance: 4a7abdbc-0453-43a8-9668-f1b377162d8f] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:08.039162 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c83a03f0-58c7-401d-b0e5-1a93940105a7 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:08.039653 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c83a03f0-58c7-401d-b0e5-1a93940105a7 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:08.040094 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c83a03f0-58c7-401d-b0e5-1a93940105a7 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:08.040800 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c83a03f0-58c7-401d-b0e5-1a93940105a7 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:08.041260 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c83a03f0-58c7-401d-b0e5-1a93940105a7 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:08.041685 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c83a03f0-58c7-401d-b0e5-1a93940105a7 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:08.071913 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-bebc27a3-bbd7-4c97-b8f1-a6043b1526b4 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:08.079265 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-bebc27a3-bbd7-4c97-b8f1-a6043b1526b4 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1521 microversion: 2.1 time: 0.173831 Aug 06 14:31:08.079833 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 123/259] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:07 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:08.178607 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-c83a03f0-58c7-401d-b0e5-1a93940105a7 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de557945688e4d9f944310015bb42163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d02ee1ad57f4d38acf0bc95ab43f614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:08.186334 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-c83a03f0-58c7-401d-b0e5-1a93940105a7 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] 10.222.0.17 "GET /compute/v2.1/servers/4a7abdbc-0453-43a8-9668-f1b377162d8f" status: 200 len: 1315 microversion: 2.1 time: 0.158637 Aug 06 14:31:08.186908 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 137/260] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:08 2022] GET /compute/v2.1/servers/4a7abdbc-0453-43a8-9668-f1b377162d8f => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:08.227393 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-99f6cfae-2bc4-4085-8602-554e15067f9a tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:08.228021 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-99f6cfae-2bc4-4085-8602-554e15067f9a tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] [instance: 0604e338-9ab8-40db-a076-0fb13ba92f24] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:08.233778 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-99f6cfae-2bc4-4085-8602-554e15067f9a tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:08.234254 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-99f6cfae-2bc4-4085-8602-554e15067f9a tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:08.234682 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-99f6cfae-2bc4-4085-8602-554e15067f9a tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:08.235413 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-99f6cfae-2bc4-4085-8602-554e15067f9a tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:08.235862 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-99f6cfae-2bc4-4085-8602-554e15067f9a tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:08.236277 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-99f6cfae-2bc4-4085-8602-554e15067f9a tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:08.351658 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-538afb11-258a-40da-bbe6-dbdc4ebe2542 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:08.352194 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-538afb11-258a-40da-bbe6-dbdc4ebe2542 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6e717f01-c854-444e-9872-51e2c1c78987] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:08.358069 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-538afb11-258a-40da-bbe6-dbdc4ebe2542 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:08.358559 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-538afb11-258a-40da-bbe6-dbdc4ebe2542 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:08.359054 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-538afb11-258a-40da-bbe6-dbdc4ebe2542 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:08.359733 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-538afb11-258a-40da-bbe6-dbdc4ebe2542 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:08.360189 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-538afb11-258a-40da-bbe6-dbdc4ebe2542 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:08.360613 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-538afb11-258a-40da-bbe6-dbdc4ebe2542 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:08.361378 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-99f6cfae-2bc4-4085-8602-554e15067f9a tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1e8506e8b34a8d9c59b4acdbf23bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ead8c81ff3486683d21f671acac6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:08.369109 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-99f6cfae-2bc4-4085-8602-554e15067f9a tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] 10.222.0.17 "GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24" status: 200 len: 1314 microversion: 2.1 time: 0.145452 Aug 06 14:31:08.369661 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 124/261] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:08 2022] GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:08.485733 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-538afb11-258a-40da-bbe6-dbdc4ebe2542 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:08.493749 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-538afb11-258a-40da-bbe6-dbdc4ebe2542 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987" status: 200 len: 1367 microversion: 2.1 time: 0.146123 Aug 06 14:31:08.494316 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 138/262] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:08 2022] GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987 => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:31:09.047165 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-a4f32a4c-c4f7-4c79-8df9-d6565b7dc518 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:09.047724 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-a4f32a4c-c4f7-4c79-8df9-d6565b7dc518 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:09.053834 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a4f32a4c-c4f7-4c79-8df9-d6565b7dc518 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:09.054324 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a4f32a4c-c4f7-4c79-8df9-d6565b7dc518 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:09.054760 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a4f32a4c-c4f7-4c79-8df9-d6565b7dc518 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:09.055748 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a4f32a4c-c4f7-4c79-8df9-d6565b7dc518 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:09.056202 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a4f32a4c-c4f7-4c79-8df9-d6565b7dc518 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:09.056627 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a4f32a4c-c4f7-4c79-8df9-d6565b7dc518 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:09.100718 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-9659de3a-0b44-4e2d-b074-a53507d22016 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:09.101868 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-9659de3a-0b44-4e2d-b074-a53507d22016 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:09.108368 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9659de3a-0b44-4e2d-b074-a53507d22016 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:09.108869 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9659de3a-0b44-4e2d-b074-a53507d22016 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:09.109310 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9659de3a-0b44-4e2d-b074-a53507d22016 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:09.110024 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9659de3a-0b44-4e2d-b074-a53507d22016 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:09.110482 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9659de3a-0b44-4e2d-b074-a53507d22016 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:09.110958 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9659de3a-0b44-4e2d-b074-a53507d22016 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:09.221931 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-a4f32a4c-c4f7-4c79-8df9-d6565b7dc518 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:09.237252 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-a4f32a4c-c4f7-4c79-8df9-d6565b7dc518 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1362 microversion: 2.1 time: 0.191083 Aug 06 14:31:09.237880 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 125/263] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:09 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1362 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:09.243003 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-7cb64450-cf9c-46de-b90c-bb592a53efb8 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:09.243812 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-7cb64450-cf9c-46de-b90c-bb592a53efb8 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] [instance: 4a7abdbc-0453-43a8-9668-f1b377162d8f] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:09.250397 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7cb64450-cf9c-46de-b90c-bb592a53efb8 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:09.250906 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7cb64450-cf9c-46de-b90c-bb592a53efb8 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:09.251354 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7cb64450-cf9c-46de-b90c-bb592a53efb8 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:09.252086 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7cb64450-cf9c-46de-b90c-bb592a53efb8 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:09.252539 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7cb64450-cf9c-46de-b90c-bb592a53efb8 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:09.252962 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7cb64450-cf9c-46de-b90c-bb592a53efb8 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:09.257315 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_cell1:SELECT=100 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:31:09.415656 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-7cb64450-cf9c-46de-b90c-bb592a53efb8 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de557945688e4d9f944310015bb42163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d02ee1ad57f4d38acf0bc95ab43f614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:09.423489 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-7cb64450-cf9c-46de-b90c-bb592a53efb8 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] 10.222.0.17 "GET /compute/v2.1/servers/4a7abdbc-0453-43a8-9668-f1b377162d8f" status: 200 len: 1315 microversion: 2.1 time: 0.184456 Aug 06 14:31:09.424244 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 126/264] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:09 2022] GET /compute/v2.1/servers/4a7abdbc-0453-43a8-9668-f1b377162d8f => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:09.428680 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [req-ff42c09a-6193-4e58-907f-ed37b4b4bf44 req-be2094a7-90c8-401b-b916-57b370323588 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b9f7623-548a-4f92-8f60-9d7ee92e0fac", "name": "network-vif-plugged", "status": "completed", "tag": "f31381da-4bc7-4a30-94e4-9ebf8fa3aaf3"}]} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:31:09.439765 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-ff42c09a-6193-4e58-907f-ed37b4b4bf44 req-be2094a7-90c8-401b-b916-57b370323588 service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:09.440271 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-ff42c09a-6193-4e58-907f-ed37b4b4bf44 req-be2094a7-90c8-401b-b916-57b370323588 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:09.440885 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-ff42c09a-6193-4e58-907f-ed37b4b4bf44 req-be2094a7-90c8-401b-b916-57b370323588 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:09.451253 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-9659de3a-0b44-4e2d-b074-a53507d22016 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:09.455271 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.compute.server_external_events [req-ff42c09a-6193-4e58-907f-ed37b4b4bf44 req-be2094a7-90c8-401b-b916-57b370323588 service nova] Creating event network-vif-plugged:f31381da-4bc7-4a30-94e4-9ebf8fa3aaf3 for instance 8b9f7623-548a-4f92-8f60-9d7ee92e0fac on hv-cinder-85199 Aug 06 14:31:09.460923 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [req-ff42c09a-6193-4e58-907f-ed37b4b4bf44 req-be2094a7-90c8-401b-b916-57b370323588 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034961 Aug 06 14:31:09.462019 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 127/265] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:31:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:31:09.464152 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-9659de3a-0b44-4e2d-b074-a53507d22016 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1521 microversion: 2.1 time: 0.367310 Aug 06 14:31:09.468182 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-0b0edf6d-a0a1-4832-8175-54a16fef9fd1 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:09.469065 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-0b0edf6d-a0a1-4832-8175-54a16fef9fd1 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] [instance: 0604e338-9ab8-40db-a076-0fb13ba92f24] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:09.476565 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 139/266] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:09 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1521 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:31:09.478357 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0b0edf6d-a0a1-4832-8175-54a16fef9fd1 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:09.478850 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0b0edf6d-a0a1-4832-8175-54a16fef9fd1 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:09.479491 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0b0edf6d-a0a1-4832-8175-54a16fef9fd1 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:09.480364 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0b0edf6d-a0a1-4832-8175-54a16fef9fd1 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:09.481041 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0b0edf6d-a0a1-4832-8175-54a16fef9fd1 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:09.481632 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0b0edf6d-a0a1-4832-8175-54a16fef9fd1 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:09.514041 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-e9547a0c-f744-4a30-beec-c20775df6fd2 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:09.514682 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-e9547a0c-f744-4a30-beec-c20775df6fd2 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6e717f01-c854-444e-9872-51e2c1c78987] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:09.521906 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e9547a0c-f744-4a30-beec-c20775df6fd2 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:09.522414 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e9547a0c-f744-4a30-beec-c20775df6fd2 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:09.523520 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e9547a0c-f744-4a30-beec-c20775df6fd2 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:09.524856 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e9547a0c-f744-4a30-beec-c20775df6fd2 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:09.525476 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e9547a0c-f744-4a30-beec-c20775df6fd2 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:09.526067 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e9547a0c-f744-4a30-beec-c20775df6fd2 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:09.633368 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-0b0edf6d-a0a1-4832-8175-54a16fef9fd1 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1e8506e8b34a8d9c59b4acdbf23bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ead8c81ff3486683d21f671acac6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:09.641459 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-0b0edf6d-a0a1-4832-8175-54a16fef9fd1 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] 10.222.0.17 "GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24" status: 200 len: 1498 microversion: 2.1 time: 0.178158 Aug 06 14:31:09.642309 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 128/267] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:09 2022] GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24 => generated 1498 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:09.761379 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-e9547a0c-f744-4a30-beec-c20775df6fd2 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:09.770789 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-e9547a0c-f744-4a30-beec-c20775df6fd2 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987" status: 200 len: 1367 microversion: 2.1 time: 0.260271 Aug 06 14:31:09.773258 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 140/268] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:09 2022] GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987 => generated 1367 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:31:09.791241 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [req-a98d92de-09db-4d47-8e91-e74414613b49 req-6a78db69-b60d-480e-899c-635e9a164ca9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a7abdbc-0453-43a8-9668-f1b377162d8f", "tag": "eb1c4bcd-c66c-4490-bc67-102c65c9591a"}]} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:31:09.801833 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-a98d92de-09db-4d47-8e91-e74414613b49 req-6a78db69-b60d-480e-899c-635e9a164ca9 service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:09.803074 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-a98d92de-09db-4d47-8e91-e74414613b49 req-6a78db69-b60d-480e-899c-635e9a164ca9 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:09.804256 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-a98d92de-09db-4d47-8e91-e74414613b49 req-6a78db69-b60d-480e-899c-635e9a164ca9 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:09.817215 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.compute.server_external_events [req-a98d92de-09db-4d47-8e91-e74414613b49 req-6a78db69-b60d-480e-899c-635e9a164ca9 service nova] Creating event network-changed:eb1c4bcd-c66c-4490-bc67-102c65c9591a for instance 4a7abdbc-0453-43a8-9668-f1b377162d8f on hv-cinder-85199 Aug 06 14:31:09.823480 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [req-a98d92de-09db-4d47-8e91-e74414613b49 req-6a78db69-b60d-480e-899c-635e9a164ca9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037388 Aug 06 14:31:09.825123 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 129/269] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:31:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:31:10.258271 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-9a2e2fc1-c5a9-40ad-87da-dd17e5184892 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:10.258890 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-9a2e2fc1-c5a9-40ad-87da-dd17e5184892 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:10.264715 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9a2e2fc1-c5a9-40ad-87da-dd17e5184892 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:10.265197 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9a2e2fc1-c5a9-40ad-87da-dd17e5184892 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:10.265633 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9a2e2fc1-c5a9-40ad-87da-dd17e5184892 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:10.266363 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9a2e2fc1-c5a9-40ad-87da-dd17e5184892 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:10.266774 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9a2e2fc1-c5a9-40ad-87da-dd17e5184892 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:10.267231 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9a2e2fc1-c5a9-40ad-87da-dd17e5184892 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:10.446354 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-18c1d150-4fa2-43f7-9e84-e48d3a868d1e tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:10.447028 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-9a2e2fc1-c5a9-40ad-87da-dd17e5184892 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:10.448637 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-18c1d150-4fa2-43f7-9e84-e48d3a868d1e tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] [instance: 4a7abdbc-0453-43a8-9668-f1b377162d8f] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:10.455617 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-18c1d150-4fa2-43f7-9e84-e48d3a868d1e tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:10.456556 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-18c1d150-4fa2-43f7-9e84-e48d3a868d1e tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:10.457342 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-18c1d150-4fa2-43f7-9e84-e48d3a868d1e tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:10.458431 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-18c1d150-4fa2-43f7-9e84-e48d3a868d1e tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:10.459278 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-18c1d150-4fa2-43f7-9e84-e48d3a868d1e tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:10.459393 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-9a2e2fc1-c5a9-40ad-87da-dd17e5184892 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1362 microversion: 2.1 time: 0.205385 Aug 06 14:31:10.460055 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 141/270] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:10 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1362 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:10.469518 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-18c1d150-4fa2-43f7-9e84-e48d3a868d1e tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:10.485668 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-ddabcdbe-0eb7-422b-8d13-b1b6a7ebbaa0 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:10.486420 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-ddabcdbe-0eb7-422b-8d13-b1b6a7ebbaa0 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:10.493325 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ddabcdbe-0eb7-422b-8d13-b1b6a7ebbaa0 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:10.493912 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ddabcdbe-0eb7-422b-8d13-b1b6a7ebbaa0 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:10.494419 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ddabcdbe-0eb7-422b-8d13-b1b6a7ebbaa0 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:10.496013 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ddabcdbe-0eb7-422b-8d13-b1b6a7ebbaa0 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:10.496013 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ddabcdbe-0eb7-422b-8d13-b1b6a7ebbaa0 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:10.496237 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ddabcdbe-0eb7-422b-8d13-b1b6a7ebbaa0 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:10.615549 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-18c1d150-4fa2-43f7-9e84-e48d3a868d1e tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de557945688e4d9f944310015bb42163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d02ee1ad57f4d38acf0bc95ab43f614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:10.623469 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-18c1d150-4fa2-43f7-9e84-e48d3a868d1e tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] 10.222.0.17 "GET /compute/v2.1/servers/4a7abdbc-0453-43a8-9668-f1b377162d8f" status: 200 len: 1315 microversion: 2.1 time: 0.182608 Aug 06 14:31:10.624029 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 130/271] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:10 2022] GET /compute/v2.1/servers/4a7abdbc-0453-43a8-9668-f1b377162d8f => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:10.633258 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-ddabcdbe-0eb7-422b-8d13-b1b6a7ebbaa0 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:10.641129 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-ddabcdbe-0eb7-422b-8d13-b1b6a7ebbaa0 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1521 microversion: 2.1 time: 0.159587 Aug 06 14:31:10.641688 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 142/272] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:10 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:31:10.792532 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-e5e3da23-5249-43b8-97d6-af8b37f48a9f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:10.793170 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-e5e3da23-5249-43b8-97d6-af8b37f48a9f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6e717f01-c854-444e-9872-51e2c1c78987] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:10.798970 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e5e3da23-5249-43b8-97d6-af8b37f48a9f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:10.799451 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e5e3da23-5249-43b8-97d6-af8b37f48a9f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:10.799886 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e5e3da23-5249-43b8-97d6-af8b37f48a9f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:10.800569 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e5e3da23-5249-43b8-97d6-af8b37f48a9f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:10.801018 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e5e3da23-5249-43b8-97d6-af8b37f48a9f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:10.801437 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e5e3da23-5249-43b8-97d6-af8b37f48a9f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:10.935457 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-e5e3da23-5249-43b8-97d6-af8b37f48a9f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:10.942850 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-e5e3da23-5249-43b8-97d6-af8b37f48a9f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987" status: 200 len: 1557 microversion: 2.1 time: 0.154162 Aug 06 14:31:10.943433 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 131/273] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:10 2022] GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987 => generated 1557 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:10.963222 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-2b13133e-5f77-49fd-9e63-45353c78cb5f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:10.963735 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-2b13133e-5f77-49fd-9e63-45353c78cb5f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6e717f01-c854-444e-9872-51e2c1c78987] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:10.969842 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2b13133e-5f77-49fd-9e63-45353c78cb5f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:10.970318 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2b13133e-5f77-49fd-9e63-45353c78cb5f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:10.970744 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2b13133e-5f77-49fd-9e63-45353c78cb5f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:10.971574 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2b13133e-5f77-49fd-9e63-45353c78cb5f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:10.972137 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2b13133e-5f77-49fd-9e63-45353c78cb5f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:10.972555 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2b13133e-5f77-49fd-9e63-45353c78cb5f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:11.054661 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-2b13133e-5f77-49fd-9e63-45353c78cb5f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094798 Aug 06 14:31:11.056651 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 143/274] 10.222.0.17 () {58 vars in 1275 bytes} [Sat Aug 6 14:31:10 2022] GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:31:11.112735 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-fe06eb5c-0080-4df6-b1e0-5b7554f59c03 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "075098c3-9be6-4d53-a949-2e7d8a3dc491"}} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:31:11.115141 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-fe06eb5c-0080-4df6-b1e0-5b7554f59c03 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] [instance: 0604e338-9ab8-40db-a076-0fb13ba92f24] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:11.121675 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-fe06eb5c-0080-4df6-b1e0-5b7554f59c03 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:11.122157 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-fe06eb5c-0080-4df6-b1e0-5b7554f59c03 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:11.122593 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-fe06eb5c-0080-4df6-b1e0-5b7554f59c03 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:11.123310 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-fe06eb5c-0080-4df6-b1e0-5b7554f59c03 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:11.123761 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-fe06eb5c-0080-4df6-b1e0-5b7554f59c03 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:11.124182 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-fe06eb5c-0080-4df6-b1e0-5b7554f59c03 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:11.482222 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-e10dc7e2-ecfd-43c1-8c35-9604f0e15f12 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:11.482780 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-e10dc7e2-ecfd-43c1-8c35-9604f0e15f12 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:11.495422 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e10dc7e2-ecfd-43c1-8c35-9604f0e15f12 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:11.497069 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e10dc7e2-ecfd-43c1-8c35-9604f0e15f12 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:11.498929 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e10dc7e2-ecfd-43c1-8c35-9604f0e15f12 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:11.501907 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e10dc7e2-ecfd-43c1-8c35-9604f0e15f12 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:11.503141 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e10dc7e2-ecfd-43c1-8c35-9604f0e15f12 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:11.504128 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e10dc7e2-ecfd-43c1-8c35-9604f0e15f12 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:11.783479 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-fe06eb5c-0080-4df6-b1e0-5b7554f59c03 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] 10.222.0.17 "POST /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.674095 Aug 06 14:31:11.785027 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 132/275] 10.222.0.17 () {60 vars in 1323 bytes} [Sat Aug 6 14:31:11 2022] POST /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24/os-volume_attachments => generated 194 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:31:11.792939 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-74e59cf3-276c-4d06-89a3-d954b1ee0e93 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:11.794505 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-74e59cf3-276c-4d06-89a3-d954b1ee0e93 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] [instance: 4a7abdbc-0453-43a8-9668-f1b377162d8f] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:11.802581 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-74e59cf3-276c-4d06-89a3-d954b1ee0e93 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:11.803351 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-74e59cf3-276c-4d06-89a3-d954b1ee0e93 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:11.805861 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-74e59cf3-276c-4d06-89a3-d954b1ee0e93 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:11.807134 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-74e59cf3-276c-4d06-89a3-d954b1ee0e93 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:11.807918 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-74e59cf3-276c-4d06-89a3-d954b1ee0e93 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:11.808507 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-74e59cf3-276c-4d06-89a3-d954b1ee0e93 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:11.943775 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-e10dc7e2-ecfd-43c1-8c35-9604f0e15f12 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:11.958497 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-e10dc7e2-ecfd-43c1-8c35-9604f0e15f12 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1362 microversion: 2.1 time: 0.474337 Aug 06 14:31:11.962414 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 144/276] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:11 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1362 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:31:11.967803 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-812f6ddf-7140-425d-8d81-d180bfc8ea5e tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:11.968995 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-812f6ddf-7140-425d-8d81-d180bfc8ea5e tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:11.975227 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-812f6ddf-7140-425d-8d81-d180bfc8ea5e tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:11.975954 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-812f6ddf-7140-425d-8d81-d180bfc8ea5e tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:11.976573 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-812f6ddf-7140-425d-8d81-d180bfc8ea5e tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:11.977285 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-812f6ddf-7140-425d-8d81-d180bfc8ea5e tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:11.977739 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-812f6ddf-7140-425d-8d81-d180bfc8ea5e tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:11.978162 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-812f6ddf-7140-425d-8d81-d180bfc8ea5e tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:12.123195 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-812f6ddf-7140-425d-8d81-d180bfc8ea5e tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:12.130899 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-812f6ddf-7140-425d-8d81-d180bfc8ea5e tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1521 microversion: 2.1 time: 0.167092 Aug 06 14:31:12.131518 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 145/277] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:11 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:12.247652 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-74e59cf3-276c-4d06-89a3-d954b1ee0e93 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de557945688e4d9f944310015bb42163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d02ee1ad57f4d38acf0bc95ab43f614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:12.255104 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-74e59cf3-276c-4d06-89a3-d954b1ee0e93 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] 10.222.0.17 "GET /compute/v2.1/servers/4a7abdbc-0453-43a8-9668-f1b377162d8f" status: 200 len: 1315 microversion: 2.1 time: 0.468771 Aug 06 14:31:12.255683 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 133/278] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:11 2022] GET /compute/v2.1/servers/4a7abdbc-0453-43a8-9668-f1b377162d8f => generated 1315 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:12.866856 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [req-f1f5b0e3-ecab-48f3-8ed6-ebcf1944fa4a req-bdfea7ac-5c14-47a8-9900-74c4289e12c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e717f01-c854-444e-9872-51e2c1c78987", "tag": "9540450a-1a6b-4c4e-972a-4fb6ca932a45"}]} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:31:12.882364 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-f1f5b0e3-ecab-48f3-8ed6-ebcf1944fa4a req-bdfea7ac-5c14-47a8-9900-74c4289e12c3 service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:12.882836 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-f1f5b0e3-ecab-48f3-8ed6-ebcf1944fa4a req-bdfea7ac-5c14-47a8-9900-74c4289e12c3 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:12.883498 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-f1f5b0e3-ecab-48f3-8ed6-ebcf1944fa4a req-bdfea7ac-5c14-47a8-9900-74c4289e12c3 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:12.895598 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.compute.server_external_events [req-f1f5b0e3-ecab-48f3-8ed6-ebcf1944fa4a req-bdfea7ac-5c14-47a8-9900-74c4289e12c3 service nova] Creating event network-changed:9540450a-1a6b-4c4e-972a-4fb6ca932a45 for instance 6e717f01-c854-444e-9872-51e2c1c78987 on hv-cinder-85199 Aug 06 14:31:12.901417 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [req-f1f5b0e3-ecab-48f3-8ed6-ebcf1944fa4a req-bdfea7ac-5c14-47a8-9900-74c4289e12c3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038146 Aug 06 14:31:12.902531 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 146/279] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:31:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:31:12.987072 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-1ed9b1f9-7efa-48a3-9003-72db23359392 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:12.987687 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-1ed9b1f9-7efa-48a3-9003-72db23359392 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:12.994231 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1ed9b1f9-7efa-48a3-9003-72db23359392 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:12.994714 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1ed9b1f9-7efa-48a3-9003-72db23359392 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:12.995206 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1ed9b1f9-7efa-48a3-9003-72db23359392 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:12.995908 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1ed9b1f9-7efa-48a3-9003-72db23359392 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:12.996367 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1ed9b1f9-7efa-48a3-9003-72db23359392 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:12.996792 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1ed9b1f9-7efa-48a3-9003-72db23359392 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:13.153797 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-1ed9b1f9-7efa-48a3-9003-72db23359392 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:13.158902 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-8dc7a989-4839-4fd8-82f7-62f26846968b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:13.161609 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-8dc7a989-4839-4fd8-82f7-62f26846968b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:13.172414 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-1ed9b1f9-7efa-48a3-9003-72db23359392 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1362 microversion: 2.1 time: 0.189134 Aug 06 14:31:13.173298 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 134/280] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:12 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1362 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:31:13.175580 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8dc7a989-4839-4fd8-82f7-62f26846968b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:13.176432 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8dc7a989-4839-4fd8-82f7-62f26846968b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:13.177434 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8dc7a989-4839-4fd8-82f7-62f26846968b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:13.178416 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8dc7a989-4839-4fd8-82f7-62f26846968b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:13.178904 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8dc7a989-4839-4fd8-82f7-62f26846968b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:13.179495 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8dc7a989-4839-4fd8-82f7-62f26846968b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:13.277050 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-cbf9da78-9a2a-4ad0-b264-e4fa8e04910f tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:13.277573 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-cbf9da78-9a2a-4ad0-b264-e4fa8e04910f tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] [instance: 4a7abdbc-0453-43a8-9668-f1b377162d8f] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:13.285117 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-cbf9da78-9a2a-4ad0-b264-e4fa8e04910f tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:13.285816 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-cbf9da78-9a2a-4ad0-b264-e4fa8e04910f tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:13.286405 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-cbf9da78-9a2a-4ad0-b264-e4fa8e04910f tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:13.287349 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-cbf9da78-9a2a-4ad0-b264-e4fa8e04910f tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:13.288030 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-cbf9da78-9a2a-4ad0-b264-e4fa8e04910f tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:13.288637 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-cbf9da78-9a2a-4ad0-b264-e4fa8e04910f tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:13.368962 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-8dc7a989-4839-4fd8-82f7-62f26846968b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:13.378618 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-8dc7a989-4839-4fd8-82f7-62f26846968b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1521 microversion: 2.1 time: 0.229133 Aug 06 14:31:13.391153 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 147/281] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:13 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:13.456961 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-cbf9da78-9a2a-4ad0-b264-e4fa8e04910f tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de557945688e4d9f944310015bb42163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d02ee1ad57f4d38acf0bc95ab43f614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:13.465857 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-cbf9da78-9a2a-4ad0-b264-e4fa8e04910f tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] 10.222.0.17 "GET /compute/v2.1/servers/4a7abdbc-0453-43a8-9668-f1b377162d8f" status: 200 len: 1315 microversion: 2.1 time: 0.193207 Aug 06 14:31:13.467856 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 135/282] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:13 2022] GET /compute/v2.1/servers/4a7abdbc-0453-43a8-9668-f1b377162d8f => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:31:14.193118 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-20c6cc0d-f576-471d-95c5-36e533138984 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:14.193727 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-20c6cc0d-f576-471d-95c5-36e533138984 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:14.199620 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-20c6cc0d-f576-471d-95c5-36e533138984 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:14.200095 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-20c6cc0d-f576-471d-95c5-36e533138984 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:14.200527 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-20c6cc0d-f576-471d-95c5-36e533138984 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:14.201204 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-20c6cc0d-f576-471d-95c5-36e533138984 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:14.203283 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-20c6cc0d-f576-471d-95c5-36e533138984 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:14.203283 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-20c6cc0d-f576-471d-95c5-36e533138984 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:14.350273 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-20c6cc0d-f576-471d-95c5-36e533138984 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:14.360181 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-20c6cc0d-f576-471d-95c5-36e533138984 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1362 microversion: 2.1 time: 0.170803 Aug 06 14:31:14.360747 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 148/283] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:14 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:31:14.405095 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-b0bae3ed-b2d8-40f5-beca-78414f743e57 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:14.405707 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-b0bae3ed-b2d8-40f5-beca-78414f743e57 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:14.414335 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b0bae3ed-b2d8-40f5-beca-78414f743e57 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:14.415175 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b0bae3ed-b2d8-40f5-beca-78414f743e57 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:14.415796 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b0bae3ed-b2d8-40f5-beca-78414f743e57 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:14.417305 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b0bae3ed-b2d8-40f5-beca-78414f743e57 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:14.417955 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b0bae3ed-b2d8-40f5-beca-78414f743e57 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:14.419010 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b0bae3ed-b2d8-40f5-beca-78414f743e57 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:14.490187 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-52fdd482-7424-4cfe-872f-0cc8a74ed6a9 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:14.490824 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-52fdd482-7424-4cfe-872f-0cc8a74ed6a9 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] [instance: 4a7abdbc-0453-43a8-9668-f1b377162d8f] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:14.497377 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-52fdd482-7424-4cfe-872f-0cc8a74ed6a9 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:14.497870 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-52fdd482-7424-4cfe-872f-0cc8a74ed6a9 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:14.498527 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-52fdd482-7424-4cfe-872f-0cc8a74ed6a9 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:14.499644 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-52fdd482-7424-4cfe-872f-0cc8a74ed6a9 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:14.500292 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-52fdd482-7424-4cfe-872f-0cc8a74ed6a9 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:14.500717 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-52fdd482-7424-4cfe-872f-0cc8a74ed6a9 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:14.638229 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-52fdd482-7424-4cfe-872f-0cc8a74ed6a9 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de557945688e4d9f944310015bb42163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d02ee1ad57f4d38acf0bc95ab43f614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:14.650642 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-52fdd482-7424-4cfe-872f-0cc8a74ed6a9 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] 10.222.0.17 "GET /compute/v2.1/servers/4a7abdbc-0453-43a8-9668-f1b377162d8f" status: 200 len: 1315 microversion: 2.1 time: 0.165457 Aug 06 14:31:14.651492 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 149/284] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:14 2022] GET /compute/v2.1/servers/4a7abdbc-0453-43a8-9668-f1b377162d8f => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:14.675412 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-b0bae3ed-b2d8-40f5-beca-78414f743e57 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:14.683952 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-b0bae3ed-b2d8-40f5-beca-78414f743e57 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1521 microversion: 2.1 time: 0.283230 Aug 06 14:31:14.684466 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 136/285] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:14 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1521 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:15.380491 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-1a9809af-2dad-43c4-8d58-d9d32f0cd4aa tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:15.381109 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-1a9809af-2dad-43c4-8d58-d9d32f0cd4aa tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:15.387607 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1a9809af-2dad-43c4-8d58-d9d32f0cd4aa tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:15.388091 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1a9809af-2dad-43c4-8d58-d9d32f0cd4aa tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:15.388534 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1a9809af-2dad-43c4-8d58-d9d32f0cd4aa tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:15.389220 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1a9809af-2dad-43c4-8d58-d9d32f0cd4aa tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:15.389677 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1a9809af-2dad-43c4-8d58-d9d32f0cd4aa tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:15.390104 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1a9809af-2dad-43c4-8d58-d9d32f0cd4aa tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:15.522752 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-1a9809af-2dad-43c4-8d58-d9d32f0cd4aa tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:15.530355 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-1a9809af-2dad-43c4-8d58-d9d32f0cd4aa tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1547 microversion: 2.1 time: 0.153616 Aug 06 14:31:15.530944 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 150/286] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:15 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1547 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:15.551210 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-971d32fc-5c7d-486c-88a0-2e4e55149273 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:15.551721 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-971d32fc-5c7d-486c-88a0-2e4e55149273 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:15.558947 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-971d32fc-5c7d-486c-88a0-2e4e55149273 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:15.559432 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-971d32fc-5c7d-486c-88a0-2e4e55149273 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:15.559865 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-971d32fc-5c7d-486c-88a0-2e4e55149273 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:15.560559 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-971d32fc-5c7d-486c-88a0-2e4e55149273 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:15.561015 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-971d32fc-5c7d-486c-88a0-2e4e55149273 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:15.561438 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-971d32fc-5c7d-486c-88a0-2e4e55149273 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:15.640748 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-971d32fc-5c7d-486c-88a0-2e4e55149273 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093419 Aug 06 14:31:15.641334 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 137/287] 10.222.0.17 () {58 vars in 1275 bytes} [Sat Aug 6 14:31:15 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:31:15.671988 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-d5e453da-3023-4e31-b8bc-53ef86622809 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:15.672607 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-d5e453da-3023-4e31-b8bc-53ef86622809 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] [instance: 4a7abdbc-0453-43a8-9668-f1b377162d8f] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:15.678466 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d5e453da-3023-4e31-b8bc-53ef86622809 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:15.679651 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d5e453da-3023-4e31-b8bc-53ef86622809 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:15.680092 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d5e453da-3023-4e31-b8bc-53ef86622809 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:15.681059 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d5e453da-3023-4e31-b8bc-53ef86622809 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:15.681515 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d5e453da-3023-4e31-b8bc-53ef86622809 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:15.681941 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d5e453da-3023-4e31-b8bc-53ef86622809 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:15.707971 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-f251bd6a-df6a-42e4-a2b0-700e8fe59229 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:15.708478 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-f251bd6a-df6a-42e4-a2b0-700e8fe59229 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:15.716322 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f251bd6a-df6a-42e4-a2b0-700e8fe59229 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:15.717124 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f251bd6a-df6a-42e4-a2b0-700e8fe59229 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:15.717736 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f251bd6a-df6a-42e4-a2b0-700e8fe59229 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:15.718643 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f251bd6a-df6a-42e4-a2b0-700e8fe59229 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:15.719403 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f251bd6a-df6a-42e4-a2b0-700e8fe59229 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:15.719972 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f251bd6a-df6a-42e4-a2b0-700e8fe59229 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:15.840216 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-d5e453da-3023-4e31-b8bc-53ef86622809 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de557945688e4d9f944310015bb42163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d02ee1ad57f4d38acf0bc95ab43f614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:15.848492 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-d5e453da-3023-4e31-b8bc-53ef86622809 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] 10.222.0.17 "GET /compute/v2.1/servers/4a7abdbc-0453-43a8-9668-f1b377162d8f" status: 200 len: 1315 microversion: 2.1 time: 0.180956 Aug 06 14:31:15.863334 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 151/288] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:15 2022] GET /compute/v2.1/servers/4a7abdbc-0453-43a8-9668-f1b377162d8f => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:16.087575 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-f251bd6a-df6a-42e4-a2b0-700e8fe59229 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:16.095588 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-f251bd6a-df6a-42e4-a2b0-700e8fe59229 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1521 microversion: 2.1 time: 0.393255 Aug 06 14:31:16.096156 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 138/289] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:15 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1521 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:16.870076 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-00505f97-b097-4ca7-beff-d0c74b663f52 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:16.870712 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-00505f97-b097-4ca7-beff-d0c74b663f52 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] [instance: 4a7abdbc-0453-43a8-9668-f1b377162d8f] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:16.876681 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-00505f97-b097-4ca7-beff-d0c74b663f52 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:16.877100 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-00505f97-b097-4ca7-beff-d0c74b663f52 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:16.877532 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-00505f97-b097-4ca7-beff-d0c74b663f52 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:16.878220 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-00505f97-b097-4ca7-beff-d0c74b663f52 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:16.878684 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-00505f97-b097-4ca7-beff-d0c74b663f52 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:16.879124 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-00505f97-b097-4ca7-beff-d0c74b663f52 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:17.020616 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-00505f97-b097-4ca7-beff-d0c74b663f52 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de557945688e4d9f944310015bb42163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d02ee1ad57f4d38acf0bc95ab43f614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:17.028310 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-00505f97-b097-4ca7-beff-d0c74b663f52 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] 10.222.0.17 "GET /compute/v2.1/servers/4a7abdbc-0453-43a8-9668-f1b377162d8f" status: 200 len: 1315 microversion: 2.1 time: 0.162523 Aug 06 14:31:17.028872 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 152/290] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:16 2022] GET /compute/v2.1/servers/4a7abdbc-0453-43a8-9668-f1b377162d8f => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:17.116927 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-2048bda3-9c01-4961-9807-90469adc1298 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:17.117539 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-2048bda3-9c01-4961-9807-90469adc1298 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:17.123679 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2048bda3-9c01-4961-9807-90469adc1298 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:17.124156 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2048bda3-9c01-4961-9807-90469adc1298 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:17.124582 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2048bda3-9c01-4961-9807-90469adc1298 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:17.125263 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2048bda3-9c01-4961-9807-90469adc1298 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:17.125711 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2048bda3-9c01-4961-9807-90469adc1298 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:17.126128 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2048bda3-9c01-4961-9807-90469adc1298 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:17.314453 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-2048bda3-9c01-4961-9807-90469adc1298 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:17.321932 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-2048bda3-9c01-4961-9807-90469adc1298 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1521 microversion: 2.1 time: 0.209430 Aug 06 14:31:17.322492 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 139/291] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:17 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:17.408985 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [req-493c6e7b-065a-4592-8dae-5089ea72db9a req-00bf200d-fadb-4f04-b279-95b7bd8cc875 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b9f7623-548a-4f92-8f60-9d7ee92e0fac", "tag": "f31381da-4bc7-4a30-94e4-9ebf8fa3aaf3"}]} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:31:17.419446 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-493c6e7b-065a-4592-8dae-5089ea72db9a req-00bf200d-fadb-4f04-b279-95b7bd8cc875 service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:17.419858 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-493c6e7b-065a-4592-8dae-5089ea72db9a req-00bf200d-fadb-4f04-b279-95b7bd8cc875 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:17.420285 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-493c6e7b-065a-4592-8dae-5089ea72db9a req-00bf200d-fadb-4f04-b279-95b7bd8cc875 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:17.431491 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.compute.server_external_events [req-493c6e7b-065a-4592-8dae-5089ea72db9a req-00bf200d-fadb-4f04-b279-95b7bd8cc875 service nova] Creating event network-changed:f31381da-4bc7-4a30-94e4-9ebf8fa3aaf3 for instance 8b9f7623-548a-4f92-8f60-9d7ee92e0fac on hv-cinder-85199 Aug 06 14:31:17.437003 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [req-493c6e7b-065a-4592-8dae-5089ea72db9a req-00bf200d-fadb-4f04-b279-95b7bd8cc875 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031452 Aug 06 14:31:17.437590 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 153/292] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:31:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 14:31:18.050756 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-255cbe57-2329-4cee-8bc8-d95a545a77eb tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:18.051479 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-255cbe57-2329-4cee-8bc8-d95a545a77eb tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] [instance: 4a7abdbc-0453-43a8-9668-f1b377162d8f] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:18.061884 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-255cbe57-2329-4cee-8bc8-d95a545a77eb tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:18.062731 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-255cbe57-2329-4cee-8bc8-d95a545a77eb tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:18.063194 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-255cbe57-2329-4cee-8bc8-d95a545a77eb tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:18.064153 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-255cbe57-2329-4cee-8bc8-d95a545a77eb tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:18.064832 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-255cbe57-2329-4cee-8bc8-d95a545a77eb tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:18.065520 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-255cbe57-2329-4cee-8bc8-d95a545a77eb tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:18.214891 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-255cbe57-2329-4cee-8bc8-d95a545a77eb tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de557945688e4d9f944310015bb42163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d02ee1ad57f4d38acf0bc95ab43f614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:18.225127 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-255cbe57-2329-4cee-8bc8-d95a545a77eb tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] 10.222.0.17 "GET /compute/v2.1/servers/4a7abdbc-0453-43a8-9668-f1b377162d8f" status: 200 len: 1315 microversion: 2.1 time: 0.179906 Aug 06 14:31:18.227110 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 140/293] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:18 2022] GET /compute/v2.1/servers/4a7abdbc-0453-43a8-9668-f1b377162d8f => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:18.349291 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-3107ded9-1eaf-421f-b4b2-ae1707a26373 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:18.350053 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-3107ded9-1eaf-421f-b4b2-ae1707a26373 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:18.356679 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-3107ded9-1eaf-421f-b4b2-ae1707a26373 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:18.357164 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-3107ded9-1eaf-421f-b4b2-ae1707a26373 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:18.357598 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-3107ded9-1eaf-421f-b4b2-ae1707a26373 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:18.358284 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-3107ded9-1eaf-421f-b4b2-ae1707a26373 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:18.358735 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-3107ded9-1eaf-421f-b4b2-ae1707a26373 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:18.359264 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-3107ded9-1eaf-421f-b4b2-ae1707a26373 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:18.515334 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-3107ded9-1eaf-421f-b4b2-ae1707a26373 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:18.523177 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-3107ded9-1eaf-421f-b4b2-ae1707a26373 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1521 microversion: 2.1 time: 0.185200 Aug 06 14:31:18.523675 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 154/294] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:18 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:19.245577 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-3303b194-2686-40cb-b5ad-ba7ce78a93f6 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:19.246175 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-3303b194-2686-40cb-b5ad-ba7ce78a93f6 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] [instance: 4a7abdbc-0453-43a8-9668-f1b377162d8f] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:19.252507 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3303b194-2686-40cb-b5ad-ba7ce78a93f6 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:19.252977 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3303b194-2686-40cb-b5ad-ba7ce78a93f6 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:19.253404 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3303b194-2686-40cb-b5ad-ba7ce78a93f6 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:19.254082 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3303b194-2686-40cb-b5ad-ba7ce78a93f6 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:19.254566 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3303b194-2686-40cb-b5ad-ba7ce78a93f6 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:19.254979 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3303b194-2686-40cb-b5ad-ba7ce78a93f6 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:19.395175 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-3303b194-2686-40cb-b5ad-ba7ce78a93f6 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de557945688e4d9f944310015bb42163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d02ee1ad57f4d38acf0bc95ab43f614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:19.403188 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-3303b194-2686-40cb-b5ad-ba7ce78a93f6 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] 10.222.0.17 "GET /compute/v2.1/servers/4a7abdbc-0453-43a8-9668-f1b377162d8f" status: 200 len: 1315 microversion: 2.1 time: 0.161318 Aug 06 14:31:19.403757 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 141/295] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:19 2022] GET /compute/v2.1/servers/4a7abdbc-0453-43a8-9668-f1b377162d8f => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:19.552786 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-4a08bd91-8737-4689-b727-9e1619d59901 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:19.554362 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-4a08bd91-8737-4689-b727-9e1619d59901 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:19.561746 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-4a08bd91-8737-4689-b727-9e1619d59901 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:19.562244 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-4a08bd91-8737-4689-b727-9e1619d59901 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:19.562688 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-4a08bd91-8737-4689-b727-9e1619d59901 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:19.563420 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-4a08bd91-8737-4689-b727-9e1619d59901 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:19.563880 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-4a08bd91-8737-4689-b727-9e1619d59901 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:19.564377 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-4a08bd91-8737-4689-b727-9e1619d59901 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:19.568495 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_cell1:SELECT=100 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:31:19.719396 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-4a08bd91-8737-4689-b727-9e1619d59901 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:19.726885 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-4a08bd91-8737-4689-b727-9e1619d59901 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1521 microversion: 2.1 time: 0.178669 Aug 06 14:31:19.727461 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 155/296] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:19 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:20.424108 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-427a6bc4-c6d8-4002-978a-92c88b5b551e tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:20.424605 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-427a6bc4-c6d8-4002-978a-92c88b5b551e tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] [instance: 4a7abdbc-0453-43a8-9668-f1b377162d8f] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:20.432280 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-427a6bc4-c6d8-4002-978a-92c88b5b551e tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:20.432766 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-427a6bc4-c6d8-4002-978a-92c88b5b551e tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:20.433194 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-427a6bc4-c6d8-4002-978a-92c88b5b551e tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:20.433975 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-427a6bc4-c6d8-4002-978a-92c88b5b551e tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:20.434468 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-427a6bc4-c6d8-4002-978a-92c88b5b551e tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:20.434903 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-427a6bc4-c6d8-4002-978a-92c88b5b551e tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:20.573824 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-427a6bc4-c6d8-4002-978a-92c88b5b551e tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de557945688e4d9f944310015bb42163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d02ee1ad57f4d38acf0bc95ab43f614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:20.582173 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-427a6bc4-c6d8-4002-978a-92c88b5b551e tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] 10.222.0.17 "GET /compute/v2.1/servers/4a7abdbc-0453-43a8-9668-f1b377162d8f" status: 200 len: 1315 microversion: 2.1 time: 0.162509 Aug 06 14:31:20.582998 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 142/297] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:20 2022] GET /compute/v2.1/servers/4a7abdbc-0453-43a8-9668-f1b377162d8f => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:20.747393 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-ba2caf04-84bf-46f3-9507-04e83797b7e9 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:20.748000 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-ba2caf04-84bf-46f3-9507-04e83797b7e9 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:20.754329 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ba2caf04-84bf-46f3-9507-04e83797b7e9 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:20.754757 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ba2caf04-84bf-46f3-9507-04e83797b7e9 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:20.755277 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ba2caf04-84bf-46f3-9507-04e83797b7e9 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:20.755972 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ba2caf04-84bf-46f3-9507-04e83797b7e9 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:20.756424 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ba2caf04-84bf-46f3-9507-04e83797b7e9 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:20.757347 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ba2caf04-84bf-46f3-9507-04e83797b7e9 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:20.947886 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-ba2caf04-84bf-46f3-9507-04e83797b7e9 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:20.958526 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-ba2caf04-84bf-46f3-9507-04e83797b7e9 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1521 microversion: 2.1 time: 0.215074 Aug 06 14:31:20.960710 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 156/298] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:20 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:21.604071 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-a02108e0-a028-44ad-8454-5a6c6f930827 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:21.604806 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-a02108e0-a028-44ad-8454-5a6c6f930827 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] [instance: 4a7abdbc-0453-43a8-9668-f1b377162d8f] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:21.611182 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a02108e0-a028-44ad-8454-5a6c6f930827 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:21.611754 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a02108e0-a028-44ad-8454-5a6c6f930827 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:21.612189 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a02108e0-a028-44ad-8454-5a6c6f930827 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:21.612873 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a02108e0-a028-44ad-8454-5a6c6f930827 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:21.613328 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a02108e0-a028-44ad-8454-5a6c6f930827 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:21.613747 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a02108e0-a028-44ad-8454-5a6c6f930827 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:21.618282 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:31:21.744884 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-a02108e0-a028-44ad-8454-5a6c6f930827 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de557945688e4d9f944310015bb42163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d02ee1ad57f4d38acf0bc95ab43f614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:21.752757 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-a02108e0-a028-44ad-8454-5a6c6f930827 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] 10.222.0.17 "GET /compute/v2.1/servers/4a7abdbc-0453-43a8-9668-f1b377162d8f" status: 200 len: 1315 microversion: 2.1 time: 0.153111 Aug 06 14:31:21.753319 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 143/299] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:21 2022] GET /compute/v2.1/servers/4a7abdbc-0453-43a8-9668-f1b377162d8f => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:21.980906 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-dc136d34-c788-4c04-a778-838234c0d406 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:21.981507 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-dc136d34-c788-4c04-a778-838234c0d406 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:21.987530 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-dc136d34-c788-4c04-a778-838234c0d406 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:21.988005 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-dc136d34-c788-4c04-a778-838234c0d406 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:21.988435 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-dc136d34-c788-4c04-a778-838234c0d406 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:21.989111 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-dc136d34-c788-4c04-a778-838234c0d406 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:21.989556 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-dc136d34-c788-4c04-a778-838234c0d406 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:21.989971 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-dc136d34-c788-4c04-a778-838234c0d406 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:22.132492 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-dc136d34-c788-4c04-a778-838234c0d406 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:22.141848 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-dc136d34-c788-4c04-a778-838234c0d406 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1521 microversion: 2.1 time: 0.164661 Aug 06 14:31:22.147003 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 157/300] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:21 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:22.773294 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-1cb55f5f-755b-4941-b572-0320468d7222 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:22.773900 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-1cb55f5f-755b-4941-b572-0320468d7222 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] [instance: 4a7abdbc-0453-43a8-9668-f1b377162d8f] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:22.780267 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1cb55f5f-755b-4941-b572-0320468d7222 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:22.780742 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1cb55f5f-755b-4941-b572-0320468d7222 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:22.781171 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1cb55f5f-755b-4941-b572-0320468d7222 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:22.781942 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1cb55f5f-755b-4941-b572-0320468d7222 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:22.782397 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1cb55f5f-755b-4941-b572-0320468d7222 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:22.782813 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1cb55f5f-755b-4941-b572-0320468d7222 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:22.923581 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-1cb55f5f-755b-4941-b572-0320468d7222 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de557945688e4d9f944310015bb42163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d02ee1ad57f4d38acf0bc95ab43f614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:22.931694 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-1cb55f5f-755b-4941-b572-0320468d7222 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] 10.222.0.17 "GET /compute/v2.1/servers/4a7abdbc-0453-43a8-9668-f1b377162d8f" status: 200 len: 1315 microversion: 2.1 time: 0.162281 Aug 06 14:31:22.932389 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 144/301] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:22 2022] GET /compute/v2.1/servers/4a7abdbc-0453-43a8-9668-f1b377162d8f => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:23.167868 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-056394db-85fe-44ae-a840-14b0a406c40c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:23.168523 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-056394db-85fe-44ae-a840-14b0a406c40c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:23.174524 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-056394db-85fe-44ae-a840-14b0a406c40c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:23.175040 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-056394db-85fe-44ae-a840-14b0a406c40c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:23.175483 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-056394db-85fe-44ae-a840-14b0a406c40c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:23.176267 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-056394db-85fe-44ae-a840-14b0a406c40c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:23.176619 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-056394db-85fe-44ae-a840-14b0a406c40c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:23.177049 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-056394db-85fe-44ae-a840-14b0a406c40c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:23.416525 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-056394db-85fe-44ae-a840-14b0a406c40c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:23.425766 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-056394db-85fe-44ae-a840-14b0a406c40c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1521 microversion: 2.1 time: 0.261685 Aug 06 14:31:23.426327 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 158/302] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:23 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:31:23.952623 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-faba70ea-5c85-4af8-a518-3cf6559d47ef tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:23.953255 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-faba70ea-5c85-4af8-a518-3cf6559d47ef tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] [instance: 4a7abdbc-0453-43a8-9668-f1b377162d8f] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:23.955626 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_api:SELECT=100 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:31:23.972421 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-faba70ea-5c85-4af8-a518-3cf6559d47ef tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:23.972919 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-faba70ea-5c85-4af8-a518-3cf6559d47ef tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:23.973648 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-faba70ea-5c85-4af8-a518-3cf6559d47ef tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:23.975684 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-faba70ea-5c85-4af8-a518-3cf6559d47ef tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:23.976952 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-faba70ea-5c85-4af8-a518-3cf6559d47ef tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:23.977386 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-faba70ea-5c85-4af8-a518-3cf6559d47ef tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:24.280313 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-faba70ea-5c85-4af8-a518-3cf6559d47ef tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de557945688e4d9f944310015bb42163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d02ee1ad57f4d38acf0bc95ab43f614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:24.288592 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-faba70ea-5c85-4af8-a518-3cf6559d47ef tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] 10.222.0.17 "GET /compute/v2.1/servers/4a7abdbc-0453-43a8-9668-f1b377162d8f" status: 200 len: 1315 microversion: 2.1 time: 0.339086 Aug 06 14:31:24.289247 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 145/303] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:23 2022] GET /compute/v2.1/servers/4a7abdbc-0453-43a8-9668-f1b377162d8f => generated 1315 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:24.448838 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-f49df23e-8804-40bd-a8c1-cd317b9e5e79 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:24.449436 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-f49df23e-8804-40bd-a8c1-cd317b9e5e79 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:24.455595 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f49df23e-8804-40bd-a8c1-cd317b9e5e79 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:24.455951 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f49df23e-8804-40bd-a8c1-cd317b9e5e79 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:24.459060 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f49df23e-8804-40bd-a8c1-cd317b9e5e79 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:24.459060 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f49df23e-8804-40bd-a8c1-cd317b9e5e79 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:24.459060 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f49df23e-8804-40bd-a8c1-cd317b9e5e79 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:24.459060 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f49df23e-8804-40bd-a8c1-cd317b9e5e79 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:24.596193 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-f49df23e-8804-40bd-a8c1-cd317b9e5e79 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:24.603615 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-f49df23e-8804-40bd-a8c1-cd317b9e5e79 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1521 microversion: 2.1 time: 0.158827 Aug 06 14:31:24.604365 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 159/304] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:24 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:24.776119 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-6f533907-9a82-4974-abde-bf086176b88c tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:24.776627 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-6f533907-9a82-4974-abde-bf086176b88c tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] [instance: 0604e338-9ab8-40db-a076-0fb13ba92f24] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:24.782807 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6f533907-9a82-4974-abde-bf086176b88c tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:24.783358 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6f533907-9a82-4974-abde-bf086176b88c tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:24.783808 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6f533907-9a82-4974-abde-bf086176b88c tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:24.784768 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6f533907-9a82-4974-abde-bf086176b88c tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:24.785812 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6f533907-9a82-4974-abde-bf086176b88c tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:24.786303 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6f533907-9a82-4974-abde-bf086176b88c tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:24.822257 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-6f533907-9a82-4974-abde-bf086176b88c tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] [instance: 0604e338-9ab8-40db-a076-0fb13ba92f24] Going to try to terminate instance {{(pid=117838) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 14:31:24.939588 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-6f533907-9a82-4974-abde-bf086176b88c tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24" status: 204 len: 0 microversion: 2.1 time: 0.168410 Aug 06 14:31:24.940407 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 146/305] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Aug 6 14:31:24 2022] DELETE /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 14:31:24.949598 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-862c9fc1-1781-43d5-8f14-2ab06d62109d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:24.950406 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-862c9fc1-1781-43d5-8f14-2ab06d62109d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] [instance: 0604e338-9ab8-40db-a076-0fb13ba92f24] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:24.956543 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-862c9fc1-1781-43d5-8f14-2ab06d62109d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:24.957014 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-862c9fc1-1781-43d5-8f14-2ab06d62109d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:24.957448 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-862c9fc1-1781-43d5-8f14-2ab06d62109d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:24.958340 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-862c9fc1-1781-43d5-8f14-2ab06d62109d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:24.958800 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-862c9fc1-1781-43d5-8f14-2ab06d62109d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:24.959939 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-862c9fc1-1781-43d5-8f14-2ab06d62109d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:25.119571 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-862c9fc1-1781-43d5-8f14-2ab06d62109d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1e8506e8b34a8d9c59b4acdbf23bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ead8c81ff3486683d21f671acac6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:25.127634 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-862c9fc1-1781-43d5-8f14-2ab06d62109d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] 10.222.0.17 "GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24" status: 200 len: 1550 microversion: 2.1 time: 0.182225 Aug 06 14:31:25.128214 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 160/306] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:24 2022] GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24 => generated 1550 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:25.309904 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-16a60195-09e1-487c-8019-f0182c9b266e tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:25.310676 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-16a60195-09e1-487c-8019-f0182c9b266e tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] [instance: 4a7abdbc-0453-43a8-9668-f1b377162d8f] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:25.317663 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-16a60195-09e1-487c-8019-f0182c9b266e tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:25.318157 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-16a60195-09e1-487c-8019-f0182c9b266e tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:25.318636 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-16a60195-09e1-487c-8019-f0182c9b266e tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:25.319903 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-16a60195-09e1-487c-8019-f0182c9b266e tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:25.320373 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-16a60195-09e1-487c-8019-f0182c9b266e tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:25.320828 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-16a60195-09e1-487c-8019-f0182c9b266e tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:25.461413 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-16a60195-09e1-487c-8019-f0182c9b266e tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de557945688e4d9f944310015bb42163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d02ee1ad57f4d38acf0bc95ab43f614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:25.470450 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-16a60195-09e1-487c-8019-f0182c9b266e tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] 10.222.0.17 "GET /compute/v2.1/servers/4a7abdbc-0453-43a8-9668-f1b377162d8f" status: 200 len: 1315 microversion: 2.1 time: 0.164879 Aug 06 14:31:25.471318 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 147/307] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:25 2022] GET /compute/v2.1/servers/4a7abdbc-0453-43a8-9668-f1b377162d8f => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:25.623498 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-e896c7f0-bc6c-4abb-9e7c-b73b0d4ad95f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:25.624115 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-e896c7f0-bc6c-4abb-9e7c-b73b0d4ad95f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:25.632659 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e896c7f0-bc6c-4abb-9e7c-b73b0d4ad95f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:25.633197 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e896c7f0-bc6c-4abb-9e7c-b73b0d4ad95f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:25.633650 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e896c7f0-bc6c-4abb-9e7c-b73b0d4ad95f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:25.634616 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e896c7f0-bc6c-4abb-9e7c-b73b0d4ad95f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:25.635300 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e896c7f0-bc6c-4abb-9e7c-b73b0d4ad95f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:25.635908 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e896c7f0-bc6c-4abb-9e7c-b73b0d4ad95f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:25.780445 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-e896c7f0-bc6c-4abb-9e7c-b73b0d4ad95f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:25.788807 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-e896c7f0-bc6c-4abb-9e7c-b73b0d4ad95f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1521 microversion: 2.1 time: 0.169127 Aug 06 14:31:25.789399 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 161/308] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:25 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:25.942348 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [req-58187be9-0689-4101-ab90-57170bf334d2 req-57ef1b14-1bce-4eff-9400-8733a5219dfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a7abdbc-0453-43a8-9668-f1b377162d8f", "name": "network-vif-plugged", "status": "completed", "tag": "eb1c4bcd-c66c-4490-bc67-102c65c9591a"}]} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:31:25.958215 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-58187be9-0689-4101-ab90-57170bf334d2 req-57ef1b14-1bce-4eff-9400-8733a5219dfd service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:25.959162 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-58187be9-0689-4101-ab90-57170bf334d2 req-57ef1b14-1bce-4eff-9400-8733a5219dfd service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:25.959620 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-58187be9-0689-4101-ab90-57170bf334d2 req-57ef1b14-1bce-4eff-9400-8733a5219dfd service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:25.974260 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.compute.server_external_events [req-58187be9-0689-4101-ab90-57170bf334d2 req-57ef1b14-1bce-4eff-9400-8733a5219dfd service nova] Creating event network-vif-plugged:eb1c4bcd-c66c-4490-bc67-102c65c9591a for instance 4a7abdbc-0453-43a8-9668-f1b377162d8f on hv-cinder-85199 Aug 06 14:31:25.980320 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [req-58187be9-0689-4101-ab90-57170bf334d2 req-57ef1b14-1bce-4eff-9400-8733a5219dfd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043796 Aug 06 14:31:25.981532 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 148/309] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:31:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:31:26.159062 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-a4697ee4-7b61-4e12-b79e-b040ebc87e7e tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:26.159991 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-a4697ee4-7b61-4e12-b79e-b040ebc87e7e tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] [instance: 0604e338-9ab8-40db-a076-0fb13ba92f24] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:26.172886 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a4697ee4-7b61-4e12-b79e-b040ebc87e7e tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:26.173535 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a4697ee4-7b61-4e12-b79e-b040ebc87e7e tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:26.175051 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a4697ee4-7b61-4e12-b79e-b040ebc87e7e tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:26.175884 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a4697ee4-7b61-4e12-b79e-b040ebc87e7e tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:26.176458 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a4697ee4-7b61-4e12-b79e-b040ebc87e7e tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:26.177626 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a4697ee4-7b61-4e12-b79e-b040ebc87e7e tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:26.355040 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-a4697ee4-7b61-4e12-b79e-b040ebc87e7e tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1e8506e8b34a8d9c59b4acdbf23bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ead8c81ff3486683d21f671acac6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:26.365270 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-a4697ee4-7b61-4e12-b79e-b040ebc87e7e tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] 10.222.0.17 "GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24" status: 200 len: 1550 microversion: 2.1 time: 0.210127 Aug 06 14:31:26.366328 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 162/310] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:26 2022] GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24 => generated 1550 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:26.492487 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-64642c0d-8a5a-4235-8e7f-2ed417dfcb78 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:26.493217 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-64642c0d-8a5a-4235-8e7f-2ed417dfcb78 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] [instance: 4a7abdbc-0453-43a8-9668-f1b377162d8f] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:26.499979 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-64642c0d-8a5a-4235-8e7f-2ed417dfcb78 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:26.500871 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-64642c0d-8a5a-4235-8e7f-2ed417dfcb78 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:26.501464 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-64642c0d-8a5a-4235-8e7f-2ed417dfcb78 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:26.502353 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-64642c0d-8a5a-4235-8e7f-2ed417dfcb78 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:26.503350 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-64642c0d-8a5a-4235-8e7f-2ed417dfcb78 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:26.504017 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-64642c0d-8a5a-4235-8e7f-2ed417dfcb78 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:26.811019 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-39518e44-716e-4a33-bc31-e0251cb360bd tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:26.812191 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-39518e44-716e-4a33-bc31-e0251cb360bd tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:26.822751 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-39518e44-716e-4a33-bc31-e0251cb360bd tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:26.823437 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-39518e44-716e-4a33-bc31-e0251cb360bd tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:26.823942 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-39518e44-716e-4a33-bc31-e0251cb360bd tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:26.826857 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-39518e44-716e-4a33-bc31-e0251cb360bd tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:26.827517 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-39518e44-716e-4a33-bc31-e0251cb360bd tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:26.828016 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-39518e44-716e-4a33-bc31-e0251cb360bd tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:26.968414 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-64642c0d-8a5a-4235-8e7f-2ed417dfcb78 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de557945688e4d9f944310015bb42163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d02ee1ad57f4d38acf0bc95ab43f614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:26.980256 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-64642c0d-8a5a-4235-8e7f-2ed417dfcb78 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] 10.222.0.17 "GET /compute/v2.1/servers/4a7abdbc-0453-43a8-9668-f1b377162d8f" status: 200 len: 1315 microversion: 2.1 time: 0.491849 Aug 06 14:31:26.980844 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 149/311] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:26 2022] GET /compute/v2.1/servers/4a7abdbc-0453-43a8-9668-f1b377162d8f => generated 1315 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:27.046300 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-39518e44-716e-4a33-bc31-e0251cb360bd tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:27.056839 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-39518e44-716e-4a33-bc31-e0251cb360bd tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1521 microversion: 2.1 time: 0.250398 Aug 06 14:31:27.057736 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 163/312] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:26 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1521 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:31:27.387720 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-7c39b83d-3d06-4cfc-8f89-b0b66224404d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:27.388333 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-7c39b83d-3d06-4cfc-8f89-b0b66224404d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] [instance: 0604e338-9ab8-40db-a076-0fb13ba92f24] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:27.395520 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7c39b83d-3d06-4cfc-8f89-b0b66224404d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:27.396398 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7c39b83d-3d06-4cfc-8f89-b0b66224404d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:27.396842 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7c39b83d-3d06-4cfc-8f89-b0b66224404d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:27.398101 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7c39b83d-3d06-4cfc-8f89-b0b66224404d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:27.398556 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7c39b83d-3d06-4cfc-8f89-b0b66224404d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:27.399164 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7c39b83d-3d06-4cfc-8f89-b0b66224404d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:27.639569 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-7c39b83d-3d06-4cfc-8f89-b0b66224404d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1e8506e8b34a8d9c59b4acdbf23bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ead8c81ff3486683d21f671acac6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:27.648622 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-7c39b83d-3d06-4cfc-8f89-b0b66224404d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] 10.222.0.17 "GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24" status: 200 len: 1550 microversion: 2.1 time: 0.264698 Aug 06 14:31:27.649206 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 150/313] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:27 2022] GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24 => generated 1550 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:28.000727 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-822f9aa0-f681-4c14-b0c3-551d2d5a2930 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:28.001901 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-822f9aa0-f681-4c14-b0c3-551d2d5a2930 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] [instance: 4a7abdbc-0453-43a8-9668-f1b377162d8f] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:28.011371 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-822f9aa0-f681-4c14-b0c3-551d2d5a2930 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:28.012108 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-822f9aa0-f681-4c14-b0c3-551d2d5a2930 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:28.012706 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-822f9aa0-f681-4c14-b0c3-551d2d5a2930 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:28.013567 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-822f9aa0-f681-4c14-b0c3-551d2d5a2930 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:28.014172 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-822f9aa0-f681-4c14-b0c3-551d2d5a2930 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:28.014746 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-822f9aa0-f681-4c14-b0c3-551d2d5a2930 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:28.078330 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-5c2f99fb-d45a-4c2e-a929-7ee9249927f7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:28.081268 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-5c2f99fb-d45a-4c2e-a929-7ee9249927f7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:28.090114 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5c2f99fb-d45a-4c2e-a929-7ee9249927f7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:28.091799 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5c2f99fb-d45a-4c2e-a929-7ee9249927f7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:28.093033 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5c2f99fb-d45a-4c2e-a929-7ee9249927f7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:28.094490 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5c2f99fb-d45a-4c2e-a929-7ee9249927f7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:28.095136 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5c2f99fb-d45a-4c2e-a929-7ee9249927f7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:28.095906 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5c2f99fb-d45a-4c2e-a929-7ee9249927f7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:28.221765 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-822f9aa0-f681-4c14-b0c3-551d2d5a2930 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de557945688e4d9f944310015bb42163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d02ee1ad57f4d38acf0bc95ab43f614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:28.230720 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-822f9aa0-f681-4c14-b0c3-551d2d5a2930 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] 10.222.0.17 "GET /compute/v2.1/servers/4a7abdbc-0453-43a8-9668-f1b377162d8f" status: 200 len: 1315 microversion: 2.1 time: 0.233493 Aug 06 14:31:28.232054 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 164/314] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:27 2022] GET /compute/v2.1/servers/4a7abdbc-0453-43a8-9668-f1b377162d8f => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:28.451039 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-5c2f99fb-d45a-4c2e-a929-7ee9249927f7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:28.459957 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-5c2f99fb-d45a-4c2e-a929-7ee9249927f7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1521 microversion: 2.1 time: 0.386319 Aug 06 14:31:28.460960 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 151/315] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:28 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1521 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:28.672021 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-cf2d15dd-e270-400d-8299-7339a79c5fa2 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:28.672632 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-cf2d15dd-e270-400d-8299-7339a79c5fa2 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] [instance: 0604e338-9ab8-40db-a076-0fb13ba92f24] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:28.680795 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-cf2d15dd-e270-400d-8299-7339a79c5fa2 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:28.681828 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-cf2d15dd-e270-400d-8299-7339a79c5fa2 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:28.682661 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-cf2d15dd-e270-400d-8299-7339a79c5fa2 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:28.684045 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-cf2d15dd-e270-400d-8299-7339a79c5fa2 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:28.685162 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-cf2d15dd-e270-400d-8299-7339a79c5fa2 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:28.685800 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-cf2d15dd-e270-400d-8299-7339a79c5fa2 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:28.844261 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-cf2d15dd-e270-400d-8299-7339a79c5fa2 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1e8506e8b34a8d9c59b4acdbf23bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ead8c81ff3486683d21f671acac6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:28.858431 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-cf2d15dd-e270-400d-8299-7339a79c5fa2 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] 10.222.0.17 "GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24" status: 200 len: 1550 microversion: 2.1 time: 0.192280 Aug 06 14:31:28.859041 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 165/316] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:28 2022] GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24 => generated 1550 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:29.253555 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-e835ce1a-f94a-408d-a456-72b2c2bc4757 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:29.254702 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-e835ce1a-f94a-408d-a456-72b2c2bc4757 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] [instance: 4a7abdbc-0453-43a8-9668-f1b377162d8f] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:29.263957 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e835ce1a-f94a-408d-a456-72b2c2bc4757 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:29.264652 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e835ce1a-f94a-408d-a456-72b2c2bc4757 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:29.265270 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e835ce1a-f94a-408d-a456-72b2c2bc4757 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:29.266132 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e835ce1a-f94a-408d-a456-72b2c2bc4757 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:29.266738 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e835ce1a-f94a-408d-a456-72b2c2bc4757 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:29.267342 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e835ce1a-f94a-408d-a456-72b2c2bc4757 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:29.484919 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-b16879b8-273b-4dba-ad5a-8a3a228a60e3 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:29.485523 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-b16879b8-273b-4dba-ad5a-8a3a228a60e3 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:29.492686 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b16879b8-273b-4dba-ad5a-8a3a228a60e3 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:29.493322 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b16879b8-273b-4dba-ad5a-8a3a228a60e3 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:29.493602 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b16879b8-273b-4dba-ad5a-8a3a228a60e3 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:29.494473 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b16879b8-273b-4dba-ad5a-8a3a228a60e3 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:29.495112 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b16879b8-273b-4dba-ad5a-8a3a228a60e3 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:29.495586 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b16879b8-273b-4dba-ad5a-8a3a228a60e3 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:29.596362 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-e835ce1a-f94a-408d-a456-72b2c2bc4757 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de557945688e4d9f944310015bb42163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d02ee1ad57f4d38acf0bc95ab43f614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:29.613770 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-e835ce1a-f94a-408d-a456-72b2c2bc4757 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] 10.222.0.17 "GET /compute/v2.1/servers/4a7abdbc-0453-43a8-9668-f1b377162d8f" status: 200 len: 1315 microversion: 2.1 time: 0.363908 Aug 06 14:31:29.614366 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 152/317] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:29 2022] GET /compute/v2.1/servers/4a7abdbc-0453-43a8-9668-f1b377162d8f => generated 1315 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:31:29.696118 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-b16879b8-273b-4dba-ad5a-8a3a228a60e3 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:29.704429 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-b16879b8-273b-4dba-ad5a-8a3a228a60e3 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1521 microversion: 2.1 time: 0.223440 Aug 06 14:31:29.705010 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 166/318] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:29 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:31:29.880346 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-74025c34-0013-4eb8-a18f-46c5b9927194 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:29.881313 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-74025c34-0013-4eb8-a18f-46c5b9927194 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] [instance: 0604e338-9ab8-40db-a076-0fb13ba92f24] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:29.894246 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-74025c34-0013-4eb8-a18f-46c5b9927194 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:29.894927 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-74025c34-0013-4eb8-a18f-46c5b9927194 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:29.895433 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-74025c34-0013-4eb8-a18f-46c5b9927194 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:29.896990 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-74025c34-0013-4eb8-a18f-46c5b9927194 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:29.897524 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-74025c34-0013-4eb8-a18f-46c5b9927194 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:29.898037 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-74025c34-0013-4eb8-a18f-46c5b9927194 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:30.313228 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-74025c34-0013-4eb8-a18f-46c5b9927194 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1e8506e8b34a8d9c59b4acdbf23bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ead8c81ff3486683d21f671acac6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:30.319853 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [req-118f463c-cf86-4516-8fe5-e59077552127 req-150825e1-240a-4bfb-834a-253970451da8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0604e338-9ab8-40db-a076-0fb13ba92f24", "name": "network-vif-deleted", "tag": "7957f136-33e5-4e1d-b200-e7d9374401f8"}]} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:31:30.321431 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-74025c34-0013-4eb8-a18f-46c5b9927194 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] 10.222.0.17 "GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24" status: 200 len: 1508 microversion: 2.1 time: 0.445822 Aug 06 14:31:30.322236 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 153/319] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:29 2022] GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24 => generated 1508 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:30.338930 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-118f463c-cf86-4516-8fe5-e59077552127 req-150825e1-240a-4bfb-834a-253970451da8 service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:30.339876 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-118f463c-cf86-4516-8fe5-e59077552127 req-150825e1-240a-4bfb-834a-253970451da8 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:30.340973 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-118f463c-cf86-4516-8fe5-e59077552127 req-150825e1-240a-4bfb-834a-253970451da8 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:30.359153 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.compute.server_external_events [req-118f463c-cf86-4516-8fe5-e59077552127 req-150825e1-240a-4bfb-834a-253970451da8 service nova] Creating event network-vif-deleted:7957f136-33e5-4e1d-b200-e7d9374401f8 for instance 0604e338-9ab8-40db-a076-0fb13ba92f24 on hv-cinder-85199 Aug 06 14:31:30.365729 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [req-118f463c-cf86-4516-8fe5-e59077552127 req-150825e1-240a-4bfb-834a-253970451da8 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057982 Aug 06 14:31:30.366792 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 167/320] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:31:30.636224 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-3962d400-0005-492d-9f2a-e9e4f41b31dc tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:30.636908 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-3962d400-0005-492d-9f2a-e9e4f41b31dc tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] [instance: 4a7abdbc-0453-43a8-9668-f1b377162d8f] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:30.643071 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3962d400-0005-492d-9f2a-e9e4f41b31dc tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:30.643622 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3962d400-0005-492d-9f2a-e9e4f41b31dc tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:30.644158 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3962d400-0005-492d-9f2a-e9e4f41b31dc tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:30.645025 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3962d400-0005-492d-9f2a-e9e4f41b31dc tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:30.645478 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3962d400-0005-492d-9f2a-e9e4f41b31dc tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:30.645900 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3962d400-0005-492d-9f2a-e9e4f41b31dc tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:30.725767 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-609bd97a-7a73-4be5-9e1d-d75e1d4091dd tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:30.727252 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-609bd97a-7a73-4be5-9e1d-d75e1d4091dd tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:30.733726 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-609bd97a-7a73-4be5-9e1d-d75e1d4091dd tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:30.734548 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-609bd97a-7a73-4be5-9e1d-d75e1d4091dd tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:30.735108 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-609bd97a-7a73-4be5-9e1d-d75e1d4091dd tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:30.736698 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-609bd97a-7a73-4be5-9e1d-d75e1d4091dd tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:30.737380 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-609bd97a-7a73-4be5-9e1d-d75e1d4091dd tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:30.738013 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-609bd97a-7a73-4be5-9e1d-d75e1d4091dd tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:30.900811 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-609bd97a-7a73-4be5-9e1d-d75e1d4091dd tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:30.910014 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-3962d400-0005-492d-9f2a-e9e4f41b31dc tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de557945688e4d9f944310015bb42163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d02ee1ad57f4d38acf0bc95ab43f614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:30.916404 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-609bd97a-7a73-4be5-9e1d-d75e1d4091dd tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1521 microversion: 2.1 time: 0.195622 Aug 06 14:31:30.920485 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 168/321] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:30 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:31:30.926160 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-3962d400-0005-492d-9f2a-e9e4f41b31dc tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] 10.222.0.17 "GET /compute/v2.1/servers/4a7abdbc-0453-43a8-9668-f1b377162d8f" status: 200 len: 1465 microversion: 2.1 time: 0.293778 Aug 06 14:31:30.926774 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 154/322] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:30 2022] GET /compute/v2.1/servers/4a7abdbc-0453-43a8-9668-f1b377162d8f => generated 1465 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:30.989027 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-81705a83-d71a-4d29-a8c8-80a053d399a5 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:30.989809 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-81705a83-d71a-4d29-a8c8-80a053d399a5 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] [instance: 4a7abdbc-0453-43a8-9668-f1b377162d8f] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:30.997609 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-81705a83-d71a-4d29-a8c8-80a053d399a5 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:30.998218 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-81705a83-d71a-4d29-a8c8-80a053d399a5 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:30.999083 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-81705a83-d71a-4d29-a8c8-80a053d399a5 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:31.000666 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-81705a83-d71a-4d29-a8c8-80a053d399a5 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:31.001234 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-81705a83-d71a-4d29-a8c8-80a053d399a5 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:31.002233 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-81705a83-d71a-4d29-a8c8-80a053d399a5 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:31.036665 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-81705a83-d71a-4d29-a8c8-80a053d399a5 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] [instance: 4a7abdbc-0453-43a8-9668-f1b377162d8f] Going to try to terminate instance {{(pid=117837) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 14:31:31.134667 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-81705a83-d71a-4d29-a8c8-80a053d399a5 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4a7abdbc-0453-43a8-9668-f1b377162d8f" status: 204 len: 0 microversion: 2.1 time: 0.148999 Aug 06 14:31:31.135805 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 169/323] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Aug 6 14:31:30 2022] DELETE /compute/v2.1/servers/4a7abdbc-0453-43a8-9668-f1b377162d8f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 14:31:31.143695 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-cdf360a5-5746-42c2-b0dc-3b5f7a61d0a5 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:31.144286 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-cdf360a5-5746-42c2-b0dc-3b5f7a61d0a5 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] [instance: 4a7abdbc-0453-43a8-9668-f1b377162d8f] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:31.150089 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-cdf360a5-5746-42c2-b0dc-3b5f7a61d0a5 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:31.150564 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-cdf360a5-5746-42c2-b0dc-3b5f7a61d0a5 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:31.151033 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-cdf360a5-5746-42c2-b0dc-3b5f7a61d0a5 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:31.151722 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-cdf360a5-5746-42c2-b0dc-3b5f7a61d0a5 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:31.152166 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-cdf360a5-5746-42c2-b0dc-3b5f7a61d0a5 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:31.152751 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-cdf360a5-5746-42c2-b0dc-3b5f7a61d0a5 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:31.298951 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-cdf360a5-5746-42c2-b0dc-3b5f7a61d0a5 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de557945688e4d9f944310015bb42163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d02ee1ad57f4d38acf0bc95ab43f614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:31.308734 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-cdf360a5-5746-42c2-b0dc-3b5f7a61d0a5 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] 10.222.0.17 "GET /compute/v2.1/servers/4a7abdbc-0453-43a8-9668-f1b377162d8f" status: 200 len: 1471 microversion: 2.1 time: 0.168793 Aug 06 14:31:31.309654 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 155/324] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:31 2022] GET /compute/v2.1/servers/4a7abdbc-0453-43a8-9668-f1b377162d8f => generated 1471 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:31.346571 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-f506913b-7e6e-4c1b-be43-4c178e75705e tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:31.347402 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-f506913b-7e6e-4c1b-be43-4c178e75705e tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] [instance: 0604e338-9ab8-40db-a076-0fb13ba92f24] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:31.353938 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f506913b-7e6e-4c1b-be43-4c178e75705e tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:31.354525 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f506913b-7e6e-4c1b-be43-4c178e75705e tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:31.355274 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f506913b-7e6e-4c1b-be43-4c178e75705e tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:31.356029 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f506913b-7e6e-4c1b-be43-4c178e75705e tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:31.356478 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f506913b-7e6e-4c1b-be43-4c178e75705e tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:31.356892 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f506913b-7e6e-4c1b-be43-4c178e75705e tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:31.560623 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f506913b-7e6e-4c1b-be43-4c178e75705e tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:31.561210 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f506913b-7e6e-4c1b-be43-4c178e75705e tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:31.561717 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f506913b-7e6e-4c1b-be43-4c178e75705e tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:31.562659 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.objects.instance [None req-f506913b-7e6e-4c1b-be43-4c178e75705e tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lazy-loading 'fault' on Instance uuid 0604e338-9ab8-40db-a076-0fb13ba92f24 {{(pid=117837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 14:31:31.570349 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:31:31.625035 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-f506913b-7e6e-4c1b-be43-4c178e75705e tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1e8506e8b34a8d9c59b4acdbf23bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ead8c81ff3486683d21f671acac6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:31.641988 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-f506913b-7e6e-4c1b-be43-4c178e75705e tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] 10.222.0.17 "GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24" status: 200 len: 1350 microversion: 2.1 time: 0.300859 Aug 06 14:31:31.642634 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 170/325] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:31 2022] GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24 => generated 1350 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:31.942726 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-9648aeca-8823-4849-9890-c3f11b7481ee tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:31.944000 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-9648aeca-8823-4849-9890-c3f11b7481ee tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:31.956876 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9648aeca-8823-4849-9890-c3f11b7481ee tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:31.957621 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9648aeca-8823-4849-9890-c3f11b7481ee tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:31.958137 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9648aeca-8823-4849-9890-c3f11b7481ee tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:31.959110 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9648aeca-8823-4849-9890-c3f11b7481ee tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:31.959785 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9648aeca-8823-4849-9890-c3f11b7481ee tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:31.960412 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9648aeca-8823-4849-9890-c3f11b7481ee tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:32.144970 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-9648aeca-8823-4849-9890-c3f11b7481ee tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:32.153299 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-9648aeca-8823-4849-9890-c3f11b7481ee tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1521 microversion: 2.1 time: 0.215526 Aug 06 14:31:32.171036 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 156/326] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:31 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:32.331039 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-6f38a85e-8ef5-4ce5-a1f0-03244831b7fe tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:32.333359 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-6f38a85e-8ef5-4ce5-a1f0-03244831b7fe tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] [instance: 4a7abdbc-0453-43a8-9668-f1b377162d8f] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:32.342090 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6f38a85e-8ef5-4ce5-a1f0-03244831b7fe tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:32.342765 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6f38a85e-8ef5-4ce5-a1f0-03244831b7fe tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:32.343959 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6f38a85e-8ef5-4ce5-a1f0-03244831b7fe tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:32.344863 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6f38a85e-8ef5-4ce5-a1f0-03244831b7fe tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:32.345458 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6f38a85e-8ef5-4ce5-a1f0-03244831b7fe tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:32.346054 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6f38a85e-8ef5-4ce5-a1f0-03244831b7fe tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:32.570604 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-6f38a85e-8ef5-4ce5-a1f0-03244831b7fe tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de557945688e4d9f944310015bb42163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d02ee1ad57f4d38acf0bc95ab43f614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:32.581360 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-6f38a85e-8ef5-4ce5-a1f0-03244831b7fe tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] 10.222.0.17 "GET /compute/v2.1/servers/4a7abdbc-0453-43a8-9668-f1b377162d8f" status: 200 len: 1471 microversion: 2.1 time: 0.255542 Aug 06 14:31:32.595644 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 171/327] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:32 2022] GET /compute/v2.1/servers/4a7abdbc-0453-43a8-9668-f1b377162d8f => generated 1471 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:32.662651 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-2e09c491-9e5f-4b46-bede-1a35ffa9decd tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:32.663442 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-2e09c491-9e5f-4b46-bede-1a35ffa9decd tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] [instance: 0604e338-9ab8-40db-a076-0fb13ba92f24] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:32.678550 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2e09c491-9e5f-4b46-bede-1a35ffa9decd tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:32.679879 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2e09c491-9e5f-4b46-bede-1a35ffa9decd tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:32.680911 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2e09c491-9e5f-4b46-bede-1a35ffa9decd tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:32.682131 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2e09c491-9e5f-4b46-bede-1a35ffa9decd tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:32.682763 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2e09c491-9e5f-4b46-bede-1a35ffa9decd tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:32.683956 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2e09c491-9e5f-4b46-bede-1a35ffa9decd tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:32.767139 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2e09c491-9e5f-4b46-bede-1a35ffa9decd tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:32.767630 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2e09c491-9e5f-4b46-bede-1a35ffa9decd tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:32.768071 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2e09c491-9e5f-4b46-bede-1a35ffa9decd tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:32.768534 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.objects.instance [None req-2e09c491-9e5f-4b46-bede-1a35ffa9decd tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lazy-loading 'fault' on Instance uuid 0604e338-9ab8-40db-a076-0fb13ba92f24 {{(pid=117838) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 14:31:32.886161 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-2e09c491-9e5f-4b46-bede-1a35ffa9decd tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a1e8506e8b34a8d9c59b4acdbf23bb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7ead8c81ff3486683d21f671acac6e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:32.902068 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-2e09c491-9e5f-4b46-bede-1a35ffa9decd tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] 10.222.0.17 "GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24" status: 200 len: 1350 microversion: 2.1 time: 0.243024 Aug 06 14:31:32.903808 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 157/328] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:32 2022] GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24 => generated 1350 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:33.174642 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-65768756-4e20-4b53-a94b-c891b2fc5603 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:33.175321 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-65768756-4e20-4b53-a94b-c891b2fc5603 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:33.186955 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-65768756-4e20-4b53-a94b-c891b2fc5603 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:33.187576 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-65768756-4e20-4b53-a94b-c891b2fc5603 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:33.188024 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-65768756-4e20-4b53-a94b-c891b2fc5603 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:33.188760 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-65768756-4e20-4b53-a94b-c891b2fc5603 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:33.189212 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-65768756-4e20-4b53-a94b-c891b2fc5603 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:33.189635 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-65768756-4e20-4b53-a94b-c891b2fc5603 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:33.382013 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-65768756-4e20-4b53-a94b-c891b2fc5603 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:33.391830 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-65768756-4e20-4b53-a94b-c891b2fc5603 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1521 microversion: 2.1 time: 0.221086 Aug 06 14:31:33.403910 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 172/329] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:33 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:33.618259 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-ddbededd-53ef-4548-8ca6-8a43387c3e33 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:33.619927 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-ddbededd-53ef-4548-8ca6-8a43387c3e33 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] [instance: 4a7abdbc-0453-43a8-9668-f1b377162d8f] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:33.658064 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ddbededd-53ef-4548-8ca6-8a43387c3e33 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:33.658910 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ddbededd-53ef-4548-8ca6-8a43387c3e33 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:33.659558 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ddbededd-53ef-4548-8ca6-8a43387c3e33 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:33.660513 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ddbededd-53ef-4548-8ca6-8a43387c3e33 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:33.661236 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ddbededd-53ef-4548-8ca6-8a43387c3e33 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:33.662105 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ddbededd-53ef-4548-8ca6-8a43387c3e33 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:33.684576 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:31:33.928141 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-06cc7131-56eb-40e7-af8a-d3787f6084d6 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:33.929410 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-06cc7131-56eb-40e7-af8a-d3787f6084d6 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] [instance: 0604e338-9ab8-40db-a076-0fb13ba92f24] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:33.952584 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-06cc7131-56eb-40e7-af8a-d3787f6084d6 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:33.953048 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-06cc7131-56eb-40e7-af8a-d3787f6084d6 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:33.957150 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-06cc7131-56eb-40e7-af8a-d3787f6084d6 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:33.964611 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-06cc7131-56eb-40e7-af8a-d3787f6084d6 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:33.968181 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-06cc7131-56eb-40e7-af8a-d3787f6084d6 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:33.971222 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-06cc7131-56eb-40e7-af8a-d3787f6084d6 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:34.001989 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.wsgi [None req-06cc7131-56eb-40e7-af8a-d3787f6084d6 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] HTTP exception thrown: Instance 0604e338-9ab8-40db-a076-0fb13ba92f24 could not be found. Aug 06 14:31:34.021031 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-06cc7131-56eb-40e7-af8a-d3787f6084d6 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Request method failure captured: Aug 06 14:31:34.021031 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: request: GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24 HTTP/1.1 Aug 06 14:31:34.021031 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Accept: application/json Aug 06 14:31:34.021031 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Accept-Encoding: identity Aug 06 14:31:34.021031 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Connection: close Aug 06 14:31:34.021031 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Content-Length: 0 Aug 06 14:31:34.021031 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Content-Type: application/json Aug 06 14:31:34.021031 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Host: 10.222.0.17 Aug 06 14:31:34.021031 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Openstack-System-Scope: None Aug 06 14:31:34.021031 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: User-Agent: python-urllib3/1.26.11 Aug 06 14:31:34.021031 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Auth-Token: gAAAAABi7nr0ZodIWxW3LDXPC-7kSN3L_YXap_zqfV_LiHu9Pz2T4UsmBV6b_sf7U6mPl00eqPQFAjL2vVlqZ_mJkQa-M7wWR4wc_Q-tWpliQMxhcPbxXz0OiiTWx-ZfOJjs6elHep-z3aF55g85Qg-f-oSpIC9XM7Q5psn7OAgRdEHZCTw3F74 Aug 06 14:31:34.021031 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Domain-Id: None Aug 06 14:31:34.021031 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Domain-Name: None Aug 06 14:31:34.021031 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Identity-Status: Confirmed Aug 06 14:31:34.021031 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Is-Admin-Project: True Aug 06 14:31:34.021031 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Domain-Id: default Aug 06 14:31:34.021031 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Domain-Name: Default Aug 06 14:31:34.021031 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Id: f7ead8c81ff3486683d21f671acac6e0 Aug 06 14:31:34.021031 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Name: tempest-DeleteServersTestJSON-580449038 Aug 06 14:31:34.021031 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Role: member,reader Aug 06 14:31:34.021031 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Roles: member,reader Aug 06 14:31:34.023049 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f7ead8c81ff3486683d21f671acac6e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f7ead8c81ff3486683d21f671acac6e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f7ead8c81ff3486683d21f671acac6e0", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f7ead8c81ff3486683d21f671acac6e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 06 14:31:34.023049 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant: tempest-DeleteServersTestJSON-580449038 Aug 06 14:31:34.023049 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant-Id: f7ead8c81ff3486683d21f671acac6e0 Aug 06 14:31:34.023049 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant-Name: tempest-DeleteServersTestJSON-580449038 Aug 06 14:31:34.023049 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User: tempest-DeleteServersTestJSON-580449038-project Aug 06 14:31:34.023049 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Domain-Id: default Aug 06 14:31:34.023049 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Domain-Name: Default Aug 06 14:31:34.023049 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Id: 8a1e8506e8b34a8d9c59b4acdbf23bb8 Aug 06 14:31:34.023049 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Name: tempest-DeleteServersTestJSON-580449038-project Aug 06 14:31:34.023049 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: method: > Aug 06 14:31:34.023049 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: exception: Instance 0604e338-9ab8-40db-a076-0fb13ba92f24 could not be found. Aug 06 14:31:34.023049 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: action_args: {'id': '0604e338-9ab8-40db-a076-0fb13ba92f24'} Aug 06 14:31:34.023906 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 14:31:34.023906 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:31:34.023906 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 14:31:34.023906 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 14:31:34.023906 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 14:31:34.023906 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 14:31:34.023906 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 14:31:34.023906 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 14:31:34.023906 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 14:31:34.023906 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 14:31:34.023906 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0604e338-9ab8-40db-a076-0fb13ba92f24 could not be found. Aug 06 14:31:34.023906 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:31:34.023906 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:31:34.023906 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:31:34.023906 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:31:34.023906 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:31:34.023906 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:31:34.023906 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 14:31:34.023906 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 14:31:34.023906 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 14:31:34.025321 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 14:31:34.025321 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 14:31:34.025321 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 14:31:34.025321 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 14:31:34.025321 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 14:31:34.025321 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 14:31:34.025321 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 14:31:34.025321 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0604e338-9ab8-40db-a076-0fb13ba92f24 could not be found. Aug 06 14:31:34.025321 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:31:34.025321 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:31:34.025321 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:31:34.025321 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:31:34.025321 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:31:34.025321 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:31:34.025321 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 14:31:34.025321 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 14:31:34.025321 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0604e338-9ab8-40db-a076-0fb13ba92f24 could not be found. Aug 06 14:31:34.025321 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:31:34.028106 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-06cc7131-56eb-40e7-af8a-d3787f6084d6 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Returning 404 to user: Instance 0604e338-9ab8-40db-a076-0fb13ba92f24 could not be found. {{(pid=117837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 14:31:34.029181 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-06cc7131-56eb-40e7-af8a-d3787f6084d6 tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] 10.222.0.17 "GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24" status: 404 len: 111 microversion: 2.1 time: 0.107948 Aug 06 14:31:34.029944 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 173/330] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:33 2022] GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 14:31:34.197822 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-1bc3648f-9c61-4b6c-8273-62c9a4ccab3d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:34.200189 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-1bc3648f-9c61-4b6c-8273-62c9a4ccab3d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] [instance: 0604e338-9ab8-40db-a076-0fb13ba92f24] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:34.214497 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1bc3648f-9c61-4b6c-8273-62c9a4ccab3d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:34.215650 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1bc3648f-9c61-4b6c-8273-62c9a4ccab3d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:34.219405 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1bc3648f-9c61-4b6c-8273-62c9a4ccab3d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:34.222361 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1bc3648f-9c61-4b6c-8273-62c9a4ccab3d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:34.223904 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1bc3648f-9c61-4b6c-8273-62c9a4ccab3d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:34.225368 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1bc3648f-9c61-4b6c-8273-62c9a4ccab3d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:34.258297 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.wsgi [None req-1bc3648f-9c61-4b6c-8273-62c9a4ccab3d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] HTTP exception thrown: Instance 0604e338-9ab8-40db-a076-0fb13ba92f24 could not be found. Aug 06 14:31:34.260990 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-1bc3648f-9c61-4b6c-8273-62c9a4ccab3d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Request method failure captured: Aug 06 14:31:34.260990 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: request: GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24/os-volume_attachments HTTP/1.1 Aug 06 14:31:34.260990 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Accept: application/json Aug 06 14:31:34.260990 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Accept-Encoding: identity Aug 06 14:31:34.260990 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Connection: close Aug 06 14:31:34.260990 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Content-Length: 0 Aug 06 14:31:34.260990 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Content-Type: application/json Aug 06 14:31:34.260990 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Host: 10.222.0.17 Aug 06 14:31:34.260990 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Openstack-System-Scope: None Aug 06 14:31:34.260990 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: User-Agent: python-urllib3/1.26.11 Aug 06 14:31:34.260990 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Auth-Token: gAAAAABi7nr0ZodIWxW3LDXPC-7kSN3L_YXap_zqfV_LiHu9Pz2T4UsmBV6b_sf7U6mPl00eqPQFAjL2vVlqZ_mJkQa-M7wWR4wc_Q-tWpliQMxhcPbxXz0OiiTWx-ZfOJjs6elHep-z3aF55g85Qg-f-oSpIC9XM7Q5psn7OAgRdEHZCTw3F74 Aug 06 14:31:34.260990 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Domain-Id: None Aug 06 14:31:34.260990 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Domain-Name: None Aug 06 14:31:34.260990 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Identity-Status: Confirmed Aug 06 14:31:34.260990 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Is-Admin-Project: True Aug 06 14:31:34.260990 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Domain-Id: default Aug 06 14:31:34.260990 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Domain-Name: Default Aug 06 14:31:34.260990 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Id: f7ead8c81ff3486683d21f671acac6e0 Aug 06 14:31:34.260990 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Name: tempest-DeleteServersTestJSON-580449038 Aug 06 14:31:34.260990 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Role: member,reader Aug 06 14:31:34.260990 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Roles: member,reader Aug 06 14:31:34.262902 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f7ead8c81ff3486683d21f671acac6e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f7ead8c81ff3486683d21f671acac6e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f7ead8c81ff3486683d21f671acac6e0", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f7ead8c81ff3486683d21f671acac6e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 06 14:31:34.262902 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant: tempest-DeleteServersTestJSON-580449038 Aug 06 14:31:34.262902 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant-Id: f7ead8c81ff3486683d21f671acac6e0 Aug 06 14:31:34.262902 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant-Name: tempest-DeleteServersTestJSON-580449038 Aug 06 14:31:34.262902 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User: tempest-DeleteServersTestJSON-580449038-project Aug 06 14:31:34.262902 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Domain-Id: default Aug 06 14:31:34.262902 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Domain-Name: Default Aug 06 14:31:34.262902 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Id: 8a1e8506e8b34a8d9c59b4acdbf23bb8 Aug 06 14:31:34.262902 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Name: tempest-DeleteServersTestJSON-580449038-project Aug 06 14:31:34.262902 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: method: > Aug 06 14:31:34.262902 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: exception: Instance 0604e338-9ab8-40db-a076-0fb13ba92f24 could not be found. Aug 06 14:31:34.262902 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: action_args: {'server_id': '0604e338-9ab8-40db-a076-0fb13ba92f24'} Aug 06 14:31:34.264156 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 14:31:34.264156 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:31:34.264156 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 14:31:34.264156 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 14:31:34.264156 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 14:31:34.264156 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 14:31:34.264156 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 14:31:34.264156 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 14:31:34.264156 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 14:31:34.264156 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 14:31:34.264156 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0604e338-9ab8-40db-a076-0fb13ba92f24 could not be found. Aug 06 14:31:34.264156 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:31:34.264156 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:31:34.264156 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:31:34.264156 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:31:34.264156 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:31:34.264156 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:31:34.264156 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 14:31:34.264156 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 14:31:34.264156 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 14:31:34.265642 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 14:31:34.265642 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 06 14:31:34.265642 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 14:31:34.265642 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 06 14:31:34.265642 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 14:31:34.265642 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 06 14:31:34.265642 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 06 14:31:34.265642 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 14:31:34.265642 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 14:31:34.265642 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0604e338-9ab8-40db-a076-0fb13ba92f24 could not be found. Aug 06 14:31:34.265642 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:31:34.265642 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:31:34.265642 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:31:34.265642 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:31:34.265642 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:31:34.265642 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:31:34.265642 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 14:31:34.265642 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 14:31:34.265642 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0604e338-9ab8-40db-a076-0fb13ba92f24 could not be found. Aug 06 14:31:34.265642 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:31:34.273026 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-1bc3648f-9c61-4b6c-8273-62c9a4ccab3d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Returning 404 to user: Instance 0604e338-9ab8-40db-a076-0fb13ba92f24 could not be found. {{(pid=117837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 14:31:34.274691 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-1bc3648f-9c61-4b6c-8273-62c9a4ccab3d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] 10.222.0.17 "GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.086087 Aug 06 14:31:34.283707 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 174/331] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Aug 6 14:31:34 2022] GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24/os-volume_attachments => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 14:31:34.362680 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-ddbededd-53ef-4548-8ca6-8a43387c3e33 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de557945688e4d9f944310015bb42163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d02ee1ad57f4d38acf0bc95ab43f614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:34.371955 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-ddbededd-53ef-4548-8ca6-8a43387c3e33 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] 10.222.0.17 "GET /compute/v2.1/servers/4a7abdbc-0453-43a8-9668-f1b377162d8f" status: 200 len: 1471 microversion: 2.1 time: 0.768754 Aug 06 14:31:34.373242 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 158/332] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:33 2022] GET /compute/v2.1/servers/4a7abdbc-0453-43a8-9668-f1b377162d8f => generated 1471 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:34.414668 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-9c4e3ae7-2546-47c2-b786-feb9a557743b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:34.415379 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-9c4e3ae7-2546-47c2-b786-feb9a557743b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:34.418450 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:31:34.434163 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9c4e3ae7-2546-47c2-b786-feb9a557743b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:34.436225 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9c4e3ae7-2546-47c2-b786-feb9a557743b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:34.438792 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9c4e3ae7-2546-47c2-b786-feb9a557743b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:34.439905 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9c4e3ae7-2546-47c2-b786-feb9a557743b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:34.440478 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9c4e3ae7-2546-47c2-b786-feb9a557743b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:34.441036 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9c4e3ae7-2546-47c2-b786-feb9a557743b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:34.771050 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-9c4e3ae7-2546-47c2-b786-feb9a557743b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:34.782825 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-9c4e3ae7-2546-47c2-b786-feb9a557743b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1521 microversion: 2.1 time: 0.371920 Aug 06 14:31:34.794898 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 175/333] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:34 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1521 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:35.395341 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-821d7f68-b593-45f0-926d-215b1a6b8b40 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:35.397901 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-821d7f68-b593-45f0-926d-215b1a6b8b40 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] [instance: 4a7abdbc-0453-43a8-9668-f1b377162d8f] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:35.418833 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-821d7f68-b593-45f0-926d-215b1a6b8b40 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:35.419356 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-821d7f68-b593-45f0-926d-215b1a6b8b40 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:35.431706 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-821d7f68-b593-45f0-926d-215b1a6b8b40 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:35.432745 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-821d7f68-b593-45f0-926d-215b1a6b8b40 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:35.435405 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-821d7f68-b593-45f0-926d-215b1a6b8b40 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:35.438509 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-821d7f68-b593-45f0-926d-215b1a6b8b40 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:35.578763 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [req-76fe99b5-9e54-4cce-8001-0fae16b67fc4 req-bb41d2bf-dec7-441c-a9b3-ee66562bcfba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a7abdbc-0453-43a8-9668-f1b377162d8f", "name": "network-vif-deleted", "tag": "eb1c4bcd-c66c-4490-bc67-102c65c9591a"}]} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:31:35.598985 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-76fe99b5-9e54-4cce-8001-0fae16b67fc4 req-bb41d2bf-dec7-441c-a9b3-ee66562bcfba service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:35.600586 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-76fe99b5-9e54-4cce-8001-0fae16b67fc4 req-bb41d2bf-dec7-441c-a9b3-ee66562bcfba service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:35.601269 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-76fe99b5-9e54-4cce-8001-0fae16b67fc4 req-bb41d2bf-dec7-441c-a9b3-ee66562bcfba service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:35.604799 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-821d7f68-b593-45f0-926d-215b1a6b8b40 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de557945688e4d9f944310015bb42163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d02ee1ad57f4d38acf0bc95ab43f614', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:35.618620 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-821d7f68-b593-45f0-926d-215b1a6b8b40 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] 10.222.0.17 "GET /compute/v2.1/servers/4a7abdbc-0453-43a8-9668-f1b377162d8f" status: 200 len: 1429 microversion: 2.1 time: 0.228730 Aug 06 14:31:35.620031 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 159/334] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:35 2022] GET /compute/v2.1/servers/4a7abdbc-0453-43a8-9668-f1b377162d8f => generated 1429 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:35.625340 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-4848efa4-a5b0-45ae-bb84-35afd5453c6b tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:35.626192 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-4848efa4-a5b0-45ae-bb84-35afd5453c6b tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] [instance: 0604e338-9ab8-40db-a076-0fb13ba92f24] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:35.638597 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4848efa4-a5b0-45ae-bb84-35afd5453c6b tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:35.639824 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4848efa4-a5b0-45ae-bb84-35afd5453c6b tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:35.640530 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4848efa4-a5b0-45ae-bb84-35afd5453c6b tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:35.641637 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4848efa4-a5b0-45ae-bb84-35afd5453c6b tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:35.642354 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4848efa4-a5b0-45ae-bb84-35afd5453c6b tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:35.643695 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4848efa4-a5b0-45ae-bb84-35afd5453c6b tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:35.679356 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.wsgi [None req-4848efa4-a5b0-45ae-bb84-35afd5453c6b tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] HTTP exception thrown: Instance 0604e338-9ab8-40db-a076-0fb13ba92f24 could not be found. Aug 06 14:31:35.684278 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.compute.server_external_events [req-76fe99b5-9e54-4cce-8001-0fae16b67fc4 req-bb41d2bf-dec7-441c-a9b3-ee66562bcfba service nova] Creating event network-vif-deleted:eb1c4bcd-c66c-4490-bc67-102c65c9591a for instance 4a7abdbc-0453-43a8-9668-f1b377162d8f on hv-cinder-85199 Aug 06 14:31:35.692453 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-4848efa4-a5b0-45ae-bb84-35afd5453c6b tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Request method failure captured: Aug 06 14:31:35.692453 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: request: DELETE /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24 HTTP/1.1 Aug 06 14:31:35.692453 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Accept: application/json Aug 06 14:31:35.692453 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Accept-Encoding: identity Aug 06 14:31:35.692453 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Connection: close Aug 06 14:31:35.692453 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Content-Length: 0 Aug 06 14:31:35.692453 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Content-Type: application/json Aug 06 14:31:35.692453 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Host: 10.222.0.17 Aug 06 14:31:35.692453 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Openstack-System-Scope: None Aug 06 14:31:35.692453 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: User-Agent: python-urllib3/1.26.11 Aug 06 14:31:35.692453 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Auth-Token: gAAAAABi7nr0ZodIWxW3LDXPC-7kSN3L_YXap_zqfV_LiHu9Pz2T4UsmBV6b_sf7U6mPl00eqPQFAjL2vVlqZ_mJkQa-M7wWR4wc_Q-tWpliQMxhcPbxXz0OiiTWx-ZfOJjs6elHep-z3aF55g85Qg-f-oSpIC9XM7Q5psn7OAgRdEHZCTw3F74 Aug 06 14:31:35.692453 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Domain-Id: None Aug 06 14:31:35.692453 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Domain-Name: None Aug 06 14:31:35.692453 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Identity-Status: Confirmed Aug 06 14:31:35.692453 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Is-Admin-Project: True Aug 06 14:31:35.692453 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Domain-Id: default Aug 06 14:31:35.692453 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Domain-Name: Default Aug 06 14:31:35.692453 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Id: f7ead8c81ff3486683d21f671acac6e0 Aug 06 14:31:35.692453 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Name: tempest-DeleteServersTestJSON-580449038 Aug 06 14:31:35.692453 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Role: member,reader Aug 06 14:31:35.692453 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Roles: member,reader Aug 06 14:31:35.694244 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f7ead8c81ff3486683d21f671acac6e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f7ead8c81ff3486683d21f671acac6e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f7ead8c81ff3486683d21f671acac6e0", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f7ead8c81ff3486683d21f671acac6e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 06 14:31:35.694244 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Tenant: tempest-DeleteServersTestJSON-580449038 Aug 06 14:31:35.694244 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Tenant-Id: f7ead8c81ff3486683d21f671acac6e0 Aug 06 14:31:35.694244 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Tenant-Name: tempest-DeleteServersTestJSON-580449038 Aug 06 14:31:35.694244 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User: tempest-DeleteServersTestJSON-580449038-project Aug 06 14:31:35.694244 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Domain-Id: default Aug 06 14:31:35.694244 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Domain-Name: Default Aug 06 14:31:35.694244 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Id: 8a1e8506e8b34a8d9c59b4acdbf23bb8 Aug 06 14:31:35.694244 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Name: tempest-DeleteServersTestJSON-580449038-project Aug 06 14:31:35.694244 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: method: > Aug 06 14:31:35.694244 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: exception: Instance 0604e338-9ab8-40db-a076-0fb13ba92f24 could not be found. Aug 06 14:31:35.694244 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: action_args: {'id': '0604e338-9ab8-40db-a076-0fb13ba92f24'} Aug 06 14:31:35.695379 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 14:31:35.695379 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:31:35.695379 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 14:31:35.695379 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 14:31:35.695379 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 14:31:35.695379 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 14:31:35.695379 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 14:31:35.695379 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 14:31:35.695379 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 14:31:35.695379 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 14:31:35.695379 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0604e338-9ab8-40db-a076-0fb13ba92f24 could not be found. Aug 06 14:31:35.695379 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:31:35.695379 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:31:35.695379 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:31:35.695379 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:31:35.695379 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:31:35.695379 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:31:35.695379 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 14:31:35.695379 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 14:31:35.695379 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 14:31:35.696439 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 14:31:35.696439 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 14:31:35.696439 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 14:31:35.696439 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 14:31:35.696439 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 14:31:35.696439 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 14:31:35.696439 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 14:31:35.696439 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 14:31:35.696439 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 14:31:35.696439 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0604e338-9ab8-40db-a076-0fb13ba92f24 could not be found. Aug 06 14:31:35.696439 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:31:35.696439 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:31:35.696439 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:31:35.696439 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:31:35.696439 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:31:35.696439 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:31:35.696439 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 14:31:35.696439 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 14:31:35.696439 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0604e338-9ab8-40db-a076-0fb13ba92f24 could not be found. Aug 06 14:31:35.696439 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:31:35.698190 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-4848efa4-a5b0-45ae-bb84-35afd5453c6b tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Returning 404 to user: Instance 0604e338-9ab8-40db-a076-0fb13ba92f24 could not be found. {{(pid=117838) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 14:31:35.698190 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-4848efa4-a5b0-45ae-bb84-35afd5453c6b tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] 10.222.0.17 "DELETE /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24" status: 404 len: 111 microversion: 2.1 time: 0.074359 Aug 06 14:31:35.698190 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 160/335] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Aug 6 14:31:35 2022] DELETE /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 14:31:35.708859 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [req-76fe99b5-9e54-4cce-8001-0fae16b67fc4 req-bb41d2bf-dec7-441c-a9b3-ee66562bcfba service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136070 Aug 06 14:31:35.710018 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 176/336] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:31:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:31:35.717009 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-020b588b-ada1-49c1-8676-0c21c5a0487d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:35.721640 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-020b588b-ada1-49c1-8676-0c21c5a0487d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] [instance: 0604e338-9ab8-40db-a076-0fb13ba92f24] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:35.741813 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-020b588b-ada1-49c1-8676-0c21c5a0487d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:35.743777 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-020b588b-ada1-49c1-8676-0c21c5a0487d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:35.744388 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-020b588b-ada1-49c1-8676-0c21c5a0487d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:35.745855 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-020b588b-ada1-49c1-8676-0c21c5a0487d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:35.747852 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-020b588b-ada1-49c1-8676-0c21c5a0487d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:35.748654 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-020b588b-ada1-49c1-8676-0c21c5a0487d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:35.814623 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-96a268f6-9457-4e1c-897d-3a7f9cac37ff tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:35.817598 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-96a268f6-9457-4e1c-897d-3a7f9cac37ff tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:35.840645 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.wsgi [None req-020b588b-ada1-49c1-8676-0c21c5a0487d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] HTTP exception thrown: Instance 0604e338-9ab8-40db-a076-0fb13ba92f24 could not be found. Aug 06 14:31:35.854004 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-020b588b-ada1-49c1-8676-0c21c5a0487d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Request method failure captured: Aug 06 14:31:35.854004 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: request: GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24 HTTP/1.1 Aug 06 14:31:35.854004 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Accept: application/json Aug 06 14:31:35.854004 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Accept-Encoding: identity Aug 06 14:31:35.854004 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Connection: close Aug 06 14:31:35.854004 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Content-Length: 0 Aug 06 14:31:35.854004 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Content-Type: application/json Aug 06 14:31:35.854004 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Host: 10.222.0.17 Aug 06 14:31:35.854004 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Openstack-System-Scope: None Aug 06 14:31:35.854004 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: User-Agent: python-urllib3/1.26.11 Aug 06 14:31:35.854004 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Auth-Token: gAAAAABi7nr0ZodIWxW3LDXPC-7kSN3L_YXap_zqfV_LiHu9Pz2T4UsmBV6b_sf7U6mPl00eqPQFAjL2vVlqZ_mJkQa-M7wWR4wc_Q-tWpliQMxhcPbxXz0OiiTWx-ZfOJjs6elHep-z3aF55g85Qg-f-oSpIC9XM7Q5psn7OAgRdEHZCTw3F74 Aug 06 14:31:35.854004 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Domain-Id: None Aug 06 14:31:35.854004 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Domain-Name: None Aug 06 14:31:35.854004 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Identity-Status: Confirmed Aug 06 14:31:35.854004 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Is-Admin-Project: True Aug 06 14:31:35.854004 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Domain-Id: default Aug 06 14:31:35.854004 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Domain-Name: Default Aug 06 14:31:35.854004 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Id: f7ead8c81ff3486683d21f671acac6e0 Aug 06 14:31:35.854004 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Name: tempest-DeleteServersTestJSON-580449038 Aug 06 14:31:35.854004 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Role: member,reader Aug 06 14:31:35.854004 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Roles: member,reader Aug 06 14:31:35.855337 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f7ead8c81ff3486683d21f671acac6e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f7ead8c81ff3486683d21f671acac6e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f7ead8c81ff3486683d21f671acac6e0", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f7ead8c81ff3486683d21f671acac6e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 06 14:31:35.855337 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Tenant: tempest-DeleteServersTestJSON-580449038 Aug 06 14:31:35.855337 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Tenant-Id: f7ead8c81ff3486683d21f671acac6e0 Aug 06 14:31:35.855337 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Tenant-Name: tempest-DeleteServersTestJSON-580449038 Aug 06 14:31:35.855337 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User: tempest-DeleteServersTestJSON-580449038-project Aug 06 14:31:35.855337 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Domain-Id: default Aug 06 14:31:35.855337 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Domain-Name: Default Aug 06 14:31:35.855337 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Id: 8a1e8506e8b34a8d9c59b4acdbf23bb8 Aug 06 14:31:35.855337 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Name: tempest-DeleteServersTestJSON-580449038-project Aug 06 14:31:35.855337 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: method: > Aug 06 14:31:35.855337 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: exception: Instance 0604e338-9ab8-40db-a076-0fb13ba92f24 could not be found. Aug 06 14:31:35.855337 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: action_args: {'id': '0604e338-9ab8-40db-a076-0fb13ba92f24'} Aug 06 14:31:35.856021 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 14:31:35.856021 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:31:35.856021 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 14:31:35.856021 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 14:31:35.856021 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 14:31:35.856021 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 14:31:35.856021 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 14:31:35.856021 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 14:31:35.856021 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 14:31:35.856021 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 14:31:35.856021 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0604e338-9ab8-40db-a076-0fb13ba92f24 could not be found. Aug 06 14:31:35.856021 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:31:35.856021 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:31:35.856021 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:31:35.856021 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:31:35.856021 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:31:35.856021 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:31:35.856021 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 14:31:35.856021 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 14:31:35.856021 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 14:31:35.857218 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 14:31:35.857218 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 14:31:35.857218 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 14:31:35.857218 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 14:31:35.857218 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 14:31:35.857218 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 14:31:35.857218 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 14:31:35.857218 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0604e338-9ab8-40db-a076-0fb13ba92f24 could not be found. Aug 06 14:31:35.857218 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:31:35.857218 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:31:35.857218 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:31:35.857218 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:31:35.857218 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:31:35.857218 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:31:35.857218 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 14:31:35.857218 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 14:31:35.857218 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0604e338-9ab8-40db-a076-0fb13ba92f24 could not be found. Aug 06 14:31:35.857218 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:31:35.861840 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-020b588b-ada1-49c1-8676-0c21c5a0487d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] Returning 404 to user: Instance 0604e338-9ab8-40db-a076-0fb13ba92f24 could not be found. {{(pid=117838) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 14:31:35.862216 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-96a268f6-9457-4e1c-897d-3a7f9cac37ff tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:35.862716 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-96a268f6-9457-4e1c-897d-3a7f9cac37ff tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:35.864278 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-020b588b-ada1-49c1-8676-0c21c5a0487d tempest-DeleteServersTestJSON-580449038 tempest-DeleteServersTestJSON-580449038-project] 10.222.0.17 "GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24" status: 404 len: 111 microversion: 2.1 time: 0.152400 Aug 06 14:31:35.871713 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 161/337] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:35 2022] GET /compute/v2.1/servers/0604e338-9ab8-40db-a076-0fb13ba92f24 => generated 111 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 14:31:35.888341 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-96a268f6-9457-4e1c-897d-3a7f9cac37ff tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:35.891029 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-96a268f6-9457-4e1c-897d-3a7f9cac37ff tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:35.898709 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-96a268f6-9457-4e1c-897d-3a7f9cac37ff tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:35.903188 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-96a268f6-9457-4e1c-897d-3a7f9cac37ff tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:36.638185 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-96a268f6-9457-4e1c-897d-3a7f9cac37ff tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:36.647259 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-7bd32578-14c3-4358-b40c-b2b009cc1c65 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:36.648839 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-96a268f6-9457-4e1c-897d-3a7f9cac37ff tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1521 microversion: 2.1 time: 0.845931 Aug 06 14:31:36.649350 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-7bd32578-14c3-4358-b40c-b2b009cc1c65 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] [instance: 4a7abdbc-0453-43a8-9668-f1b377162d8f] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:36.652842 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 177/338] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:35 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1521 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:36.660310 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7bd32578-14c3-4358-b40c-b2b009cc1c65 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:36.660735 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7bd32578-14c3-4358-b40c-b2b009cc1c65 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:36.661172 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7bd32578-14c3-4358-b40c-b2b009cc1c65 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:36.663714 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7bd32578-14c3-4358-b40c-b2b009cc1c65 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:36.664676 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7bd32578-14c3-4358-b40c-b2b009cc1c65 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:36.665851 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7bd32578-14c3-4358-b40c-b2b009cc1c65 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:36.939787 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.wsgi [None req-7bd32578-14c3-4358-b40c-b2b009cc1c65 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] HTTP exception thrown: Instance 4a7abdbc-0453-43a8-9668-f1b377162d8f could not be found. Aug 06 14:31:36.941648 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-7bd32578-14c3-4358-b40c-b2b009cc1c65 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Request method failure captured: Aug 06 14:31:36.941648 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: request: GET /compute/v2.1/servers/4a7abdbc-0453-43a8-9668-f1b377162d8f HTTP/1.1 Aug 06 14:31:36.941648 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Accept: application/json Aug 06 14:31:36.941648 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Accept-Encoding: identity Aug 06 14:31:36.941648 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Connection: close Aug 06 14:31:36.941648 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Content-Length: 0 Aug 06 14:31:36.941648 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Content-Type: application/json Aug 06 14:31:36.941648 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Host: 10.222.0.17 Aug 06 14:31:36.941648 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Openstack-System-Scope: None Aug 06 14:31:36.941648 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: User-Agent: python-urllib3/1.26.11 Aug 06 14:31:36.941648 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Auth-Token: gAAAAABi7nseHHiEKwCAH23IQ9GvWLcCKpGjcpLbnql8xIO0CdztLr2GBU94_oCSEbJ2AEu8qezo3N7w0Tz8bi3TU68F-oOoC03h5AxY0Ofh42jGwTZ1CShhqmp7QR0LG-MDExkSI0xjYbWK-NzO_v4vlwB29fnN17H5jPANiJBIcLl9YVD1rP0 Aug 06 14:31:36.941648 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Domain-Id: None Aug 06 14:31:36.941648 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Domain-Name: None Aug 06 14:31:36.941648 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Identity-Status: Confirmed Aug 06 14:31:36.941648 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Is-Admin-Project: True Aug 06 14:31:36.941648 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Domain-Id: default Aug 06 14:31:36.941648 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Domain-Name: Default Aug 06 14:31:36.941648 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Id: 1d02ee1ad57f4d38acf0bc95ab43f614 Aug 06 14:31:36.941648 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Name: tempest-VolumesNegativeTest-366166428 Aug 06 14:31:36.941648 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Role: member,reader Aug 06 14:31:36.941648 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Roles: member,reader Aug 06 14:31:36.943163 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1d02ee1ad57f4d38acf0bc95ab43f614"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1d02ee1ad57f4d38acf0bc95ab43f614"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1d02ee1ad57f4d38acf0bc95ab43f614", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1d02ee1ad57f4d38acf0bc95ab43f614"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 06 14:31:36.943163 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Tenant: tempest-VolumesNegativeTest-366166428 Aug 06 14:31:36.943163 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Tenant-Id: 1d02ee1ad57f4d38acf0bc95ab43f614 Aug 06 14:31:36.943163 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Tenant-Name: tempest-VolumesNegativeTest-366166428 Aug 06 14:31:36.943163 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User: tempest-VolumesNegativeTest-366166428-project Aug 06 14:31:36.943163 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Domain-Id: default Aug 06 14:31:36.943163 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Domain-Name: Default Aug 06 14:31:36.943163 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Id: de557945688e4d9f944310015bb42163 Aug 06 14:31:36.943163 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Name: tempest-VolumesNegativeTest-366166428-project Aug 06 14:31:36.943163 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: method: > Aug 06 14:31:36.943163 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: exception: Instance 4a7abdbc-0453-43a8-9668-f1b377162d8f could not be found. Aug 06 14:31:36.943163 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: action_args: {'id': '4a7abdbc-0453-43a8-9668-f1b377162d8f'} Aug 06 14:31:36.944086 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 14:31:36.944086 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:31:36.944086 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 14:31:36.944086 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 14:31:36.944086 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 14:31:36.944086 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 14:31:36.944086 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 14:31:36.944086 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 14:31:36.944086 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 14:31:36.944086 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 14:31:36.944086 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a7abdbc-0453-43a8-9668-f1b377162d8f could not be found. Aug 06 14:31:36.944086 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:31:36.944086 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:31:36.944086 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:31:36.944086 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:31:36.944086 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:31:36.944086 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:31:36.944086 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 14:31:36.944086 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 14:31:36.944086 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 14:31:36.945609 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 14:31:36.945609 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 14:31:36.945609 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 14:31:36.945609 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 14:31:36.945609 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 14:31:36.945609 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 14:31:36.945609 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 14:31:36.945609 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a7abdbc-0453-43a8-9668-f1b377162d8f could not be found. Aug 06 14:31:36.945609 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:31:36.945609 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:31:36.945609 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:31:36.945609 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:31:36.945609 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:31:36.945609 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:31:36.945609 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 14:31:36.945609 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 14:31:36.945609 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a7abdbc-0453-43a8-9668-f1b377162d8f could not be found. Aug 06 14:31:36.945609 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:31:36.949347 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-7bd32578-14c3-4358-b40c-b2b009cc1c65 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] Returning 404 to user: Instance 4a7abdbc-0453-43a8-9668-f1b377162d8f could not be found. {{(pid=117838) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 14:31:36.950900 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-7bd32578-14c3-4358-b40c-b2b009cc1c65 tempest-VolumesNegativeTest-366166428 tempest-VolumesNegativeTest-366166428-project] 10.222.0.17 "GET /compute/v2.1/servers/4a7abdbc-0453-43a8-9668-f1b377162d8f" status: 404 len: 111 microversion: 2.1 time: 0.310555 Aug 06 14:31:36.951623 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 162/339] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:36 2022] GET /compute/v2.1/servers/4a7abdbc-0453-43a8-9668-f1b377162d8f => generated 111 bytes in 313 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 14:31:37.671767 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-c5dbb015-d3c5-43ec-b1bd-959ce6434e21 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:37.672382 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-c5dbb015-d3c5-43ec-b1bd-959ce6434e21 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:37.681906 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c5dbb015-d3c5-43ec-b1bd-959ce6434e21 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:37.682571 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c5dbb015-d3c5-43ec-b1bd-959ce6434e21 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:37.683192 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c5dbb015-d3c5-43ec-b1bd-959ce6434e21 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:37.684657 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c5dbb015-d3c5-43ec-b1bd-959ce6434e21 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:37.687106 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c5dbb015-d3c5-43ec-b1bd-959ce6434e21 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:37.687713 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c5dbb015-d3c5-43ec-b1bd-959ce6434e21 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:38.005079 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-c5dbb015-d3c5-43ec-b1bd-959ce6434e21 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:38.017175 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-c5dbb015-d3c5-43ec-b1bd-959ce6434e21 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1521 microversion: 2.1 time: 0.351089 Aug 06 14:31:38.019102 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 178/340] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:37 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1521 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:38.205875 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-897b7afb-f1a3-4cf3-abb7-13ce338a7dea tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1036842456", "imageRef": "13d7ee60-c9c3-43ee-9861-a9192a114a77", "flavorRef": "452", "networks": [{"uuid": "55772903-5006-4c8e-9ad6-26d3182ad63f"}]}} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:31:38.309182 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.network.neutron [None req-897b7afb-f1a3-4cf3-abb7-13ce338a7dea tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] validate_networks() for [('55772903-5006-4c8e-9ad6-26d3182ad63f', None, None, None, None, None)] {{(pid=117838) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 14:31:39.031447 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.virt.hardware [None req-897b7afb-f1a3-4cf3-abb7-13ce338a7dea tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Flavor limits 0:0:0 {{(pid=117838) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 14:31:39.031860 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.virt.hardware [None req-897b7afb-f1a3-4cf3-abb7-13ce338a7dea tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Image limits 0:0:0 {{(pid=117838) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 14:31:39.032406 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.virt.hardware [None req-897b7afb-f1a3-4cf3-abb7-13ce338a7dea tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Flavor pref 0:0:0 {{(pid=117838) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 14:31:39.032898 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.virt.hardware [None req-897b7afb-f1a3-4cf3-abb7-13ce338a7dea tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Image pref 0:0:0 {{(pid=117838) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 14:31:39.033361 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.virt.hardware [None req-897b7afb-f1a3-4cf3-abb7-13ce338a7dea tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117838) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 14:31:39.043605 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-6bd03421-b501-4789-bbd1-9efbd97a6cc3 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:39.044845 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-6bd03421-b501-4789-bbd1-9efbd97a6cc3 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:39.055014 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6bd03421-b501-4789-bbd1-9efbd97a6cc3 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:39.056014 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6bd03421-b501-4789-bbd1-9efbd97a6cc3 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:39.056990 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6bd03421-b501-4789-bbd1-9efbd97a6cc3 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:39.058213 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6bd03421-b501-4789-bbd1-9efbd97a6cc3 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:39.058858 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6bd03421-b501-4789-bbd1-9efbd97a6cc3 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:39.060436 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6bd03421-b501-4789-bbd1-9efbd97a6cc3 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:39.060624 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-897b7afb-f1a3-4cf3-abb7-13ce338a7dea tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:39.061109 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-897b7afb-f1a3-4cf3-abb7-13ce338a7dea tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:39.061535 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-897b7afb-f1a3-4cf3-abb7-13ce338a7dea tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:39.063567 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-897b7afb-f1a3-4cf3-abb7-13ce338a7dea tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:39.064030 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-897b7afb-f1a3-4cf3-abb7-13ce338a7dea tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:39.064447 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-897b7afb-f1a3-4cf3-abb7-13ce338a7dea tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:39.110645 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.quota [None req-897b7afb-f1a3-4cf3-abb7-13ce338a7dea tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Getting quotas for project 59e7a9fef10f4aba994347a5d714f17f. Resources: {'cores', 'instances', 'ram'} {{(pid=117838) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 14:31:39.115963 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.quota [None req-897b7afb-f1a3-4cf3-abb7-13ce338a7dea tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Getting quotas for user eb6f411ed91946eba54e46799edb12d3 and project 59e7a9fef10f4aba994347a5d714f17f. Resources: {'cores', 'instances', 'ram'} {{(pid=117838) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 14:31:39.137108 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-897b7afb-f1a3-4cf3-abb7-13ce338a7dea tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Going to run 1 instances... {{(pid=117838) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 14:31:39.140261 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-897b7afb-f1a3-4cf3-abb7-13ce338a7dea tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] [instance: 81104a95-fe7a-4983-b5c5-2ad4d2463832] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='13d7ee60-c9c3-43ee-9861-a9192a114a77',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117838) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 14:31:39.204012 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-897b7afb-f1a3-4cf3-abb7-13ce338a7dea tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.003720 Aug 06 14:31:39.204936 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 163/341] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Aug 6 14:31:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1006 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 14:31:39.217628 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-005b6788-55a0-44fb-ac64-705284d37561 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:39.218975 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-005b6788-55a0-44fb-ac64-705284d37561 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] [instance: 81104a95-fe7a-4983-b5c5-2ad4d2463832] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:39.354840 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-005b6788-55a0-44fb-ac64-705284d37561 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6f411ed91946eba54e46799edb12d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e7a9fef10f4aba994347a5d714f17f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:39.363837 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-005b6788-55a0-44fb-ac64-705284d37561 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] 10.222.0.17 "GET /compute/v2.1/servers/81104a95-fe7a-4983-b5c5-2ad4d2463832" status: 200 len: 1219 microversion: 2.1 time: 0.150580 Aug 06 14:31:39.365379 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-6bd03421-b501-4789-bbd1-9efbd97a6cc3 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:39.368172 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 164/342] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:39 2022] GET /compute/v2.1/servers/81104a95-fe7a-4983-b5c5-2ad4d2463832 => generated 1219 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:39.382073 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-6bd03421-b501-4789-bbd1-9efbd97a6cc3 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1521 microversion: 2.1 time: 0.338505 Aug 06 14:31:39.383562 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 179/343] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:39 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1521 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:31:40.387810 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-a037c638-1f5d-46a4-806f-79070da5135e tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:40.388451 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-a037c638-1f5d-46a4-806f-79070da5135e tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] [instance: 81104a95-fe7a-4983-b5c5-2ad4d2463832] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:40.406990 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-bfd7b1cb-531b-403c-b551-226916f511f7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:40.407687 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-bfd7b1cb-531b-403c-b551-226916f511f7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:40.437045 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a037c638-1f5d-46a4-806f-79070da5135e tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:40.437667 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a037c638-1f5d-46a4-806f-79070da5135e tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:40.438046 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a037c638-1f5d-46a4-806f-79070da5135e tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:40.438687 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a037c638-1f5d-46a4-806f-79070da5135e tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:40.439155 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a037c638-1f5d-46a4-806f-79070da5135e tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:40.454707 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-bfd7b1cb-531b-403c-b551-226916f511f7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:40.455234 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-bfd7b1cb-531b-403c-b551-226916f511f7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:40.456050 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-bfd7b1cb-531b-403c-b551-226916f511f7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:40.456268 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a037c638-1f5d-46a4-806f-79070da5135e tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:40.457123 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-bfd7b1cb-531b-403c-b551-226916f511f7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:40.457845 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-bfd7b1cb-531b-403c-b551-226916f511f7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:40.458512 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-bfd7b1cb-531b-403c-b551-226916f511f7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:40.739583 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-bfd7b1cb-531b-403c-b551-226916f511f7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:40.750011 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-bfd7b1cb-531b-403c-b551-226916f511f7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1521 microversion: 2.1 time: 0.348058 Aug 06 14:31:40.750840 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 180/344] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:40 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1521 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:40.950140 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-a037c638-1f5d-46a4-806f-79070da5135e tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6f411ed91946eba54e46799edb12d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e7a9fef10f4aba994347a5d714f17f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:40.961348 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-a037c638-1f5d-46a4-806f-79070da5135e tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] 10.222.0.17 "GET /compute/v2.1/servers/81104a95-fe7a-4983-b5c5-2ad4d2463832" status: 200 len: 1215 microversion: 2.1 time: 0.574655 Aug 06 14:31:40.971762 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 165/345] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:40 2022] GET /compute/v2.1/servers/81104a95-fe7a-4983-b5c5-2ad4d2463832 => generated 1215 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:41.772898 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-338026e8-da65-44b7-9fc1-10926cc11ee7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:41.774225 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-338026e8-da65-44b7-9fc1-10926cc11ee7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:41.794101 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-338026e8-da65-44b7-9fc1-10926cc11ee7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:41.801799 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-338026e8-da65-44b7-9fc1-10926cc11ee7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:41.802479 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-338026e8-da65-44b7-9fc1-10926cc11ee7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:41.803940 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-338026e8-da65-44b7-9fc1-10926cc11ee7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:41.804499 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-338026e8-da65-44b7-9fc1-10926cc11ee7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:41.805995 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-338026e8-da65-44b7-9fc1-10926cc11ee7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:41.980002 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-f98c5f50-9e7d-4533-9777-370acc8405ae tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:41.980604 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-f98c5f50-9e7d-4533-9777-370acc8405ae tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] [instance: 81104a95-fe7a-4983-b5c5-2ad4d2463832] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:41.989732 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f98c5f50-9e7d-4533-9777-370acc8405ae tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:41.990279 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f98c5f50-9e7d-4533-9777-370acc8405ae tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:41.990717 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f98c5f50-9e7d-4533-9777-370acc8405ae tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:41.999571 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f98c5f50-9e7d-4533-9777-370acc8405ae tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:42.005461 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f98c5f50-9e7d-4533-9777-370acc8405ae tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:42.018698 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f98c5f50-9e7d-4533-9777-370acc8405ae tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:42.148491 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-338026e8-da65-44b7-9fc1-10926cc11ee7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:42.156685 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-338026e8-da65-44b7-9fc1-10926cc11ee7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1521 microversion: 2.1 time: 0.388595 Aug 06 14:31:42.157263 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 181/346] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:41 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1521 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:42.270860 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-f98c5f50-9e7d-4533-9777-370acc8405ae tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6f411ed91946eba54e46799edb12d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e7a9fef10f4aba994347a5d714f17f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:42.297905 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-f98c5f50-9e7d-4533-9777-370acc8405ae tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] 10.222.0.17 "GET /compute/v2.1/servers/81104a95-fe7a-4983-b5c5-2ad4d2463832" status: 200 len: 1277 microversion: 2.1 time: 0.322383 Aug 06 14:31:42.301558 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 166/347] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:41 2022] GET /compute/v2.1/servers/81104a95-fe7a-4983-b5c5-2ad4d2463832 => generated 1277 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:43.180252 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-39176d2c-507f-4962-b2df-1825d88bc29f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:43.181951 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-39176d2c-507f-4962-b2df-1825d88bc29f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:43.196712 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-39176d2c-507f-4962-b2df-1825d88bc29f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:43.199064 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-39176d2c-507f-4962-b2df-1825d88bc29f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:43.201664 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-39176d2c-507f-4962-b2df-1825d88bc29f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:43.220942 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-39176d2c-507f-4962-b2df-1825d88bc29f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:43.229959 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-39176d2c-507f-4962-b2df-1825d88bc29f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:43.230774 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-39176d2c-507f-4962-b2df-1825d88bc29f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:43.320340 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-2767a3d0-e630-4668-a388-f63b4b8e3d96 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:43.321643 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-2767a3d0-e630-4668-a388-f63b4b8e3d96 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] [instance: 81104a95-fe7a-4983-b5c5-2ad4d2463832] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:43.346309 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2767a3d0-e630-4668-a388-f63b4b8e3d96 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:43.350945 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2767a3d0-e630-4668-a388-f63b4b8e3d96 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:43.352194 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2767a3d0-e630-4668-a388-f63b4b8e3d96 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:43.359299 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2767a3d0-e630-4668-a388-f63b4b8e3d96 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:43.359796 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2767a3d0-e630-4668-a388-f63b4b8e3d96 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:43.360238 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2767a3d0-e630-4668-a388-f63b4b8e3d96 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:43.530001 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-39176d2c-507f-4962-b2df-1825d88bc29f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:43.543954 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-39176d2c-507f-4962-b2df-1825d88bc29f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1521 microversion: 2.1 time: 0.368485 Aug 06 14:31:43.546639 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 182/348] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:43 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1521 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:43.993465 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-2767a3d0-e630-4668-a388-f63b4b8e3d96 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6f411ed91946eba54e46799edb12d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e7a9fef10f4aba994347a5d714f17f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:44.020090 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-2767a3d0-e630-4668-a388-f63b4b8e3d96 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] 10.222.0.17 "GET /compute/v2.1/servers/81104a95-fe7a-4983-b5c5-2ad4d2463832" status: 200 len: 1319 microversion: 2.1 time: 0.704141 Aug 06 14:31:44.022065 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 167/349] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:43 2022] GET /compute/v2.1/servers/81104a95-fe7a-4983-b5c5-2ad4d2463832 => generated 1319 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:44.572165 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-f86014ae-31c9-48ee-b159-391555bb3845 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:44.572865 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-f86014ae-31c9-48ee-b159-391555bb3845 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:44.598998 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f86014ae-31c9-48ee-b159-391555bb3845 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:44.600237 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f86014ae-31c9-48ee-b159-391555bb3845 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:44.602184 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f86014ae-31c9-48ee-b159-391555bb3845 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:44.605623 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f86014ae-31c9-48ee-b159-391555bb3845 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:44.606097 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f86014ae-31c9-48ee-b159-391555bb3845 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:44.606529 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f86014ae-31c9-48ee-b159-391555bb3845 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:44.877475 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-f86014ae-31c9-48ee-b159-391555bb3845 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:44.892285 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-f86014ae-31c9-48ee-b159-391555bb3845 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1521 microversion: 2.1 time: 0.326015 Aug 06 14:31:44.893857 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 183/350] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:44 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1521 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:44.929551 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [req-dc416f0d-f634-47b2-a33e-03224c2564b5 req-57fca85d-f960-4573-8114-9f239c0e115e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81104a95-fe7a-4983-b5c5-2ad4d2463832", "tag": "40e19162-8595-40db-9b52-bf0b15a595ec"}]} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:31:44.952492 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-dc416f0d-f634-47b2-a33e-03224c2564b5 req-57fca85d-f960-4573-8114-9f239c0e115e service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:44.953149 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-dc416f0d-f634-47b2-a33e-03224c2564b5 req-57fca85d-f960-4573-8114-9f239c0e115e service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:44.953758 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-dc416f0d-f634-47b2-a33e-03224c2564b5 req-57fca85d-f960-4573-8114-9f239c0e115e service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:44.967114 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.compute.server_external_events [req-dc416f0d-f634-47b2-a33e-03224c2564b5 req-57fca85d-f960-4573-8114-9f239c0e115e service nova] Creating event network-changed:40e19162-8595-40db-9b52-bf0b15a595ec for instance 81104a95-fe7a-4983-b5c5-2ad4d2463832 on hv-cinder-85199 Aug 06 14:31:44.973852 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [req-dc416f0d-f634-47b2-a33e-03224c2564b5 req-57fca85d-f960-4573-8114-9f239c0e115e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048734 Aug 06 14:31:44.975079 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 168/351] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:31:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:31:45.047313 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-151da833-9048-4735-ba93-e89af2a54204 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:45.047986 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-151da833-9048-4735-ba93-e89af2a54204 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] [instance: 81104a95-fe7a-4983-b5c5-2ad4d2463832] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:45.057999 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-151da833-9048-4735-ba93-e89af2a54204 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:45.058489 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-151da833-9048-4735-ba93-e89af2a54204 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:45.058940 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-151da833-9048-4735-ba93-e89af2a54204 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:45.067213 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-151da833-9048-4735-ba93-e89af2a54204 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:45.073219 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-151da833-9048-4735-ba93-e89af2a54204 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:45.074475 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-151da833-9048-4735-ba93-e89af2a54204 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:45.321147 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-151da833-9048-4735-ba93-e89af2a54204 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6f411ed91946eba54e46799edb12d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e7a9fef10f4aba994347a5d714f17f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:45.331292 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-151da833-9048-4735-ba93-e89af2a54204 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] 10.222.0.17 "GET /compute/v2.1/servers/81104a95-fe7a-4983-b5c5-2ad4d2463832" status: 200 len: 1319 microversion: 2.1 time: 0.294213 Aug 06 14:31:45.332766 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 184/352] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:45 2022] GET /compute/v2.1/servers/81104a95-fe7a-4983-b5c5-2ad4d2463832 => generated 1319 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:45.919280 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-2080db33-cb39-4034-9006-5b6048c9f3f0 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:45.919908 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-2080db33-cb39-4034-9006-5b6048c9f3f0 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:45.933230 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2080db33-cb39-4034-9006-5b6048c9f3f0 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:45.933815 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2080db33-cb39-4034-9006-5b6048c9f3f0 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:45.934219 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2080db33-cb39-4034-9006-5b6048c9f3f0 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:45.937964 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2080db33-cb39-4034-9006-5b6048c9f3f0 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:45.938472 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2080db33-cb39-4034-9006-5b6048c9f3f0 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:45.938947 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2080db33-cb39-4034-9006-5b6048c9f3f0 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:46.206574 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-2080db33-cb39-4034-9006-5b6048c9f3f0 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:46.218135 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-2080db33-cb39-4034-9006-5b6048c9f3f0 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1521 microversion: 2.1 time: 0.305293 Aug 06 14:31:46.220359 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 169/353] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:45 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1521 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:31:46.353805 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-c8abc59e-bf9b-49c2-b4da-68e86a19ee20 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:46.354520 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-c8abc59e-bf9b-49c2-b4da-68e86a19ee20 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] [instance: 81104a95-fe7a-4983-b5c5-2ad4d2463832] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:46.362579 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c8abc59e-bf9b-49c2-b4da-68e86a19ee20 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:46.364800 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c8abc59e-bf9b-49c2-b4da-68e86a19ee20 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:46.366284 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c8abc59e-bf9b-49c2-b4da-68e86a19ee20 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:46.367273 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c8abc59e-bf9b-49c2-b4da-68e86a19ee20 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:46.367801 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c8abc59e-bf9b-49c2-b4da-68e86a19ee20 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:46.368293 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c8abc59e-bf9b-49c2-b4da-68e86a19ee20 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:46.535360 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-c8abc59e-bf9b-49c2-b4da-68e86a19ee20 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6f411ed91946eba54e46799edb12d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e7a9fef10f4aba994347a5d714f17f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:46.545589 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-c8abc59e-bf9b-49c2-b4da-68e86a19ee20 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] 10.222.0.17 "GET /compute/v2.1/servers/81104a95-fe7a-4983-b5c5-2ad4d2463832" status: 200 len: 1319 microversion: 2.1 time: 0.196061 Aug 06 14:31:46.546767 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 185/354] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:46 2022] GET /compute/v2.1/servers/81104a95-fe7a-4983-b5c5-2ad4d2463832 => generated 1319 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:47.243118 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-58b2535c-4a6d-46ec-8941-72210d0eb1f7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:47.243745 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-58b2535c-4a6d-46ec-8941-72210d0eb1f7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:47.254548 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-58b2535c-4a6d-46ec-8941-72210d0eb1f7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:47.255087 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-58b2535c-4a6d-46ec-8941-72210d0eb1f7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:47.255524 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-58b2535c-4a6d-46ec-8941-72210d0eb1f7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:47.256766 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-58b2535c-4a6d-46ec-8941-72210d0eb1f7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:47.257217 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-58b2535c-4a6d-46ec-8941-72210d0eb1f7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:47.257637 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-58b2535c-4a6d-46ec-8941-72210d0eb1f7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:47.412341 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-58b2535c-4a6d-46ec-8941-72210d0eb1f7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:47.420380 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-58b2535c-4a6d-46ec-8941-72210d0eb1f7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1521 microversion: 2.1 time: 0.182722 Aug 06 14:31:47.421163 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 170/355] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:47 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:47.569950 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-2fea8cea-0145-472c-89ea-0e9a99507aa1 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:47.570556 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-2fea8cea-0145-472c-89ea-0e9a99507aa1 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] [instance: 81104a95-fe7a-4983-b5c5-2ad4d2463832] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:47.576981 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2fea8cea-0145-472c-89ea-0e9a99507aa1 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:47.577462 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2fea8cea-0145-472c-89ea-0e9a99507aa1 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:47.577892 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2fea8cea-0145-472c-89ea-0e9a99507aa1 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:47.578580 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2fea8cea-0145-472c-89ea-0e9a99507aa1 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:47.579182 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2fea8cea-0145-472c-89ea-0e9a99507aa1 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:47.579760 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2fea8cea-0145-472c-89ea-0e9a99507aa1 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:47.727350 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-2fea8cea-0145-472c-89ea-0e9a99507aa1 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6f411ed91946eba54e46799edb12d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e7a9fef10f4aba994347a5d714f17f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:47.739666 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-2fea8cea-0145-472c-89ea-0e9a99507aa1 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] 10.222.0.17 "GET /compute/v2.1/servers/81104a95-fe7a-4983-b5c5-2ad4d2463832" status: 200 len: 1319 microversion: 2.1 time: 0.174167 Aug 06 14:31:47.752057 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 186/356] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:47 2022] GET /compute/v2.1/servers/81104a95-fe7a-4983-b5c5-2ad4d2463832 => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:48.111078 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-b8e45ed9-2743-473e-b594-6272414c74a2 tempest-VolumesTestJSON-1783496427 tempest-VolumesTestJSON-1783496427-project] Calling method '.version_select at 0x7fbab17caca0>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:48.166448 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-b8e45ed9-2743-473e-b594-6272414c74a2 tempest-VolumesTestJSON-1783496427 tempest-VolumesTestJSON-1783496427-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/8a8a12da-3ab5-4b36-9e65-3aa59ff87236" status: 200 len: 350 microversion: 2.1 time: 0.059111 Aug 06 14:31:48.169981 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 171/357] 10.222.0.17 () {58 vars in 1245 bytes} [Sat Aug 6 14:31:48 2022] GET /compute/v2.1/os-volumes/8a8a12da-3ab5-4b36-9e65-3aa59ff87236 => generated 350 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:31:48.444816 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-7d05d790-298b-416f-93ed-828437b89b3d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:48.445462 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-7d05d790-298b-416f-93ed-828437b89b3d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:48.455666 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7d05d790-298b-416f-93ed-828437b89b3d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:48.456401 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7d05d790-298b-416f-93ed-828437b89b3d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:48.458092 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7d05d790-298b-416f-93ed-828437b89b3d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:48.459447 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7d05d790-298b-416f-93ed-828437b89b3d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:48.459846 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7d05d790-298b-416f-93ed-828437b89b3d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:48.462937 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7d05d790-298b-416f-93ed-828437b89b3d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:48.665311 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-7d05d790-298b-416f-93ed-828437b89b3d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:48.673341 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-7d05d790-298b-416f-93ed-828437b89b3d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1501 microversion: 2.1 time: 0.233946 Aug 06 14:31:48.673927 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 187/358] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:48 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1501 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:48.695106 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-dce287ee-bdc9-4006-bd42-a5ee3a317380 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:48.696550 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-dce287ee-bdc9-4006-bd42-a5ee3a317380 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: d1cbde5c-7d9e-49cc-ba65-31507c04c60b] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:48.719064 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-dce287ee-bdc9-4006-bd42-a5ee3a317380 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:48.726419 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-dce287ee-bdc9-4006-bd42-a5ee3a317380 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:48.728302 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-dce287ee-bdc9-4006-bd42-a5ee3a317380 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:48.731298 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-dce287ee-bdc9-4006-bd42-a5ee3a317380 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:48.732088 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-dce287ee-bdc9-4006-bd42-a5ee3a317380 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:48.732873 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-dce287ee-bdc9-4006-bd42-a5ee3a317380 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:48.773110 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-dbb37430-a5e1-47cb-8803-ad30858888db tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:48.773852 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-dbb37430-a5e1-47cb-8803-ad30858888db tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] [instance: 81104a95-fe7a-4983-b5c5-2ad4d2463832] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:48.781313 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-dbb37430-a5e1-47cb-8803-ad30858888db tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:48.785017 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-dbb37430-a5e1-47cb-8803-ad30858888db tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:48.787378 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-dbb37430-a5e1-47cb-8803-ad30858888db tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:48.788227 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-dbb37430-a5e1-47cb-8803-ad30858888db tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:48.788775 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-dbb37430-a5e1-47cb-8803-ad30858888db tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:48.790340 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-dbb37430-a5e1-47cb-8803-ad30858888db tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:48.948710 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-dce287ee-bdc9-4006-bd42-a5ee3a317380 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:48.957166 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-dce287ee-bdc9-4006-bd42-a5ee3a317380 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b" status: 200 len: 1516 microversion: 2.1 time: 0.266479 Aug 06 14:31:48.957753 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 172/359] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:48 2022] GET /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b => generated 1516 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:48.970806 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-dbb37430-a5e1-47cb-8803-ad30858888db tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6f411ed91946eba54e46799edb12d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e7a9fef10f4aba994347a5d714f17f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:48.978636 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-dbb37430-a5e1-47cb-8803-ad30858888db tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] 10.222.0.17 "GET /compute/v2.1/servers/81104a95-fe7a-4983-b5c5-2ad4d2463832" status: 200 len: 1319 microversion: 2.1 time: 0.209983 Aug 06 14:31:48.980014 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 188/360] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:48 2022] GET /compute/v2.1/servers/81104a95-fe7a-4983-b5c5-2ad4d2463832 => generated 1319 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:49.602175 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-31fecd3a-5696-4491-99e8-ebf2eebd86a7 tempest-VolumesTestJSON-1783496427 tempest-VolumesTestJSON-1783496427-project] Calling method '.version_select at 0x7fbab20a3d30>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:49.608849 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_cell0:SELECT=2 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:31:49.610192 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_cell0:SELECT=8 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:31:49.663000 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-31fecd3a-5696-4491-99e8-ebf2eebd86a7 tempest-VolumesTestJSON-1783496427 tempest-VolumesTestJSON-1783496427-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/e46bf866-b16a-40c5-b210-35129969739b" status: 200 len: 350 microversion: 2.1 time: 0.064610 Aug 06 14:31:49.663629 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 173/361] 10.222.0.17 () {58 vars in 1245 bytes} [Sat Aug 6 14:31:49 2022] GET /compute/v2.1/os-volumes/e46bf866-b16a-40c5-b210-35129969739b => generated 350 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 14:31:50.000624 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-a79cd11d-28a9-4f67-9c39-951c22180eb8 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:50.001837 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-a79cd11d-28a9-4f67-9c39-951c22180eb8 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] [instance: 81104a95-fe7a-4983-b5c5-2ad4d2463832] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:50.011507 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a79cd11d-28a9-4f67-9c39-951c22180eb8 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:50.018556 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a79cd11d-28a9-4f67-9c39-951c22180eb8 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:50.019069 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a79cd11d-28a9-4f67-9c39-951c22180eb8 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:50.020192 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a79cd11d-28a9-4f67-9c39-951c22180eb8 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:50.020668 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a79cd11d-28a9-4f67-9c39-951c22180eb8 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:50.021427 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a79cd11d-28a9-4f67-9c39-951c22180eb8 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:50.045864 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_cell1:SELECT=100 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:31:50.183735 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-a79cd11d-28a9-4f67-9c39-951c22180eb8 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6f411ed91946eba54e46799edb12d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e7a9fef10f4aba994347a5d714f17f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:50.191848 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-a79cd11d-28a9-4f67-9c39-951c22180eb8 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] 10.222.0.17 "GET /compute/v2.1/servers/81104a95-fe7a-4983-b5c5-2ad4d2463832" status: 200 len: 1319 microversion: 2.1 time: 0.195126 Aug 06 14:31:50.206453 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 189/362] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:49 2022] GET /compute/v2.1/servers/81104a95-fe7a-4983-b5c5-2ad4d2463832 => generated 1319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:50.415646 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-058a15db-5394-492a-aa52-6e445d5e6167 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:31:50.418028 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-058a15db-5394-492a-aa52-6e445d5e6167 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: d1cbde5c-7d9e-49cc-ba65-31507c04c60b] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:50.424972 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-058a15db-5394-492a-aa52-6e445d5e6167 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:50.425545 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-058a15db-5394-492a-aa52-6e445d5e6167 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:50.426068 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-058a15db-5394-492a-aa52-6e445d5e6167 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:50.426844 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-058a15db-5394-492a-aa52-6e445d5e6167 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:50.427377 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-058a15db-5394-492a-aa52-6e445d5e6167 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:50.427993 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-058a15db-5394-492a-aa52-6e445d5e6167 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:50.452002 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.objects.instance [None req-058a15db-5394-492a-aa52-6e445d5e6167 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lazy-loading 'flavor' on Instance uuid d1cbde5c-7d9e-49cc-ba65-31507c04c60b {{(pid=117838) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 14:31:50.567707 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-058a15db-5394-492a-aa52-6e445d5e6167 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "POST /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b/action" status: 200 len: 32 microversion: 2.1 time: 0.157054 Aug 06 14:31:50.572727 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 174/363] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Aug 6 14:31:50 2022] POST /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b/action => generated 32 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 14:31:50.578093 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-bbd41e2f-2b9a-41a7-86e6-a6df9cf8a030 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:50.578826 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-bbd41e2f-2b9a-41a7-86e6-a6df9cf8a030 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: d1cbde5c-7d9e-49cc-ba65-31507c04c60b] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:50.585420 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-bbd41e2f-2b9a-41a7-86e6-a6df9cf8a030 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:50.586162 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-bbd41e2f-2b9a-41a7-86e6-a6df9cf8a030 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:50.586966 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-bbd41e2f-2b9a-41a7-86e6-a6df9cf8a030 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:50.590556 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-bbd41e2f-2b9a-41a7-86e6-a6df9cf8a030 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:50.591142 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-bbd41e2f-2b9a-41a7-86e6-a6df9cf8a030 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:50.591679 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-bbd41e2f-2b9a-41a7-86e6-a6df9cf8a030 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:50.734111 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-bbd41e2f-2b9a-41a7-86e6-a6df9cf8a030 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:50.742937 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-bbd41e2f-2b9a-41a7-86e6-a6df9cf8a030 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b" status: 200 len: 1522 microversion: 2.1 time: 0.168814 Aug 06 14:31:50.743661 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 190/364] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:50 2022] GET /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:51.101480 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-2d9887ce-3bd1-4c26-81d5-1a9f3fd0f501 tempest-VolumesTestJSON-1783496427 tempest-VolumesTestJSON-1783496427-project] Calling method '.version_select at 0x7fbab17caa60>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:51.157433 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-2d9887ce-3bd1-4c26-81d5-1a9f3fd0f501 tempest-VolumesTestJSON-1783496427 tempest-VolumesTestJSON-1783496427-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/0a546e75-f514-40b2-824f-0f6e1f6266a7" status: 200 len: 350 microversion: 2.1 time: 0.060084 Aug 06 14:31:51.157990 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 175/365] 10.222.0.17 () {58 vars in 1245 bytes} [Sat Aug 6 14:31:51 2022] GET /compute/v2.1/os-volumes/0a546e75-f514-40b2-824f-0f6e1f6266a7 => generated 350 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:31:51.170396 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-61228bb2-6944-4bc1-829f-2f15813858ce tempest-VolumesTestJSON-1783496427 tempest-VolumesTestJSON-1783496427-project] Calling method '.version_select at 0x7fbab0e17820>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:51.212921 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-7453b8aa-122b-4f25-a0c5-6096a62d545b tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:51.213920 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-7453b8aa-122b-4f25-a0c5-6096a62d545b tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] [instance: 81104a95-fe7a-4983-b5c5-2ad4d2463832] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:51.221119 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7453b8aa-122b-4f25-a0c5-6096a62d545b tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:51.221842 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7453b8aa-122b-4f25-a0c5-6096a62d545b tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:51.222456 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7453b8aa-122b-4f25-a0c5-6096a62d545b tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:51.223389 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7453b8aa-122b-4f25-a0c5-6096a62d545b tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:51.224038 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7453b8aa-122b-4f25-a0c5-6096a62d545b tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:51.224684 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7453b8aa-122b-4f25-a0c5-6096a62d545b tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:51.269343 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-61228bb2-6944-4bc1-829f-2f15813858ce tempest-VolumesTestJSON-1783496427 tempest-VolumesTestJSON-1783496427-project] 10.222.0.17 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.102718 Aug 06 14:31:51.271064 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 191/366] 10.222.0.17 () {58 vars in 1134 bytes} [Sat Aug 6 14:31:51 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:51.284095 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-490d191d-fb3d-4fb2-8cbf-7487c38fb10b tempest-VolumesTestJSON-1783496427 tempest-VolumesTestJSON-1783496427-project] Calling method '.version_select at 0x7fbab0e14310>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:51.464897 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-7453b8aa-122b-4f25-a0c5-6096a62d545b tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6f411ed91946eba54e46799edb12d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e7a9fef10f4aba994347a5d714f17f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:51.474089 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-7453b8aa-122b-4f25-a0c5-6096a62d545b tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] 10.222.0.17 "GET /compute/v2.1/servers/81104a95-fe7a-4983-b5c5-2ad4d2463832" status: 200 len: 1319 microversion: 2.1 time: 0.265205 Aug 06 14:31:51.478204 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 176/367] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:51 2022] GET /compute/v2.1/servers/81104a95-fe7a-4983-b5c5-2ad4d2463832 => generated 1319 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:31:51.574914 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-490d191d-fb3d-4fb2-8cbf-7487c38fb10b tempest-VolumesTestJSON-1783496427 tempest-VolumesTestJSON-1783496427-project] 10.222.0.17 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.292997 Aug 06 14:31:51.574914 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 192/368] 10.222.0.17 () {58 vars in 1149 bytes} [Sat Aug 6 14:31:51 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:31:51.589262 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-d0e2d522-a205-4c05-b726-8ac60589f687 tempest-VolumesTestJSON-1783496427 tempest-VolumesTestJSON-1783496427-project] Calling method '.version_select at 0x7fbab17cae50>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:51.764204 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-51c273a9-c271-4164-988f-3508cfe74088 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:51.765241 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-51c273a9-c271-4164-988f-3508cfe74088 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: d1cbde5c-7d9e-49cc-ba65-31507c04c60b] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:51.776764 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-51c273a9-c271-4164-988f-3508cfe74088 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:51.777555 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-51c273a9-c271-4164-988f-3508cfe74088 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:51.778289 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-51c273a9-c271-4164-988f-3508cfe74088 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:51.779301 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-51c273a9-c271-4164-988f-3508cfe74088 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:51.779909 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-51c273a9-c271-4164-988f-3508cfe74088 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:51.780487 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-51c273a9-c271-4164-988f-3508cfe74088 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:51.867207 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-d0e2d522-a205-4c05-b726-8ac60589f687 tempest-VolumesTestJSON-1783496427 tempest-VolumesTestJSON-1783496427-project] 10.222.0.17 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.283035 Aug 06 14:31:51.867767 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 177/369] 10.222.0.17 () {58 vars in 1134 bytes} [Sat Aug 6 14:31:51 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:51.880889 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-72c35c7b-b757-4641-9161-a3d64323ef4d tempest-VolumesTestJSON-1783496427 tempest-VolumesTestJSON-1783496427-project] Calling method '.version_select at 0x7fbab17e03a0>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:51.950464 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-51c273a9-c271-4164-988f-3508cfe74088 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:51.958327 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-51c273a9-c271-4164-988f-3508cfe74088 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b" status: 200 len: 1522 microversion: 2.1 time: 0.197839 Aug 06 14:31:51.959459 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 193/370] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:51 2022] GET /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:52.007350 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-72c35c7b-b757-4641-9161-a3d64323ef4d tempest-VolumesTestJSON-1783496427 tempest-VolumesTestJSON-1783496427-project] 10.222.0.17 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.130234 Aug 06 14:31:52.008118 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 178/371] 10.222.0.17 () {58 vars in 1167 bytes} [Sat Aug 6 14:31:51 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:31:52.022493 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-fea4e220-c580-43a6-909a-f7120a568bf6 tempest-VolumesTestJSON-1783496427 tempest-VolumesTestJSON-1783496427-project] Calling method '.version_select at 0x7fbab187b9d0>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:52.121775 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-fea4e220-c580-43a6-909a-f7120a568bf6 tempest-VolumesTestJSON-1783496427 tempest-VolumesTestJSON-1783496427-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.103679 Aug 06 14:31:52.122784 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 194/372] 10.222.0.17 () {58 vars in 1170 bytes} [Sat Aug 6 14:31:52 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:31:52.136526 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-58a3b29d-b374-4534-9200-c13063dc77cd tempest-VolumesTestJSON-1783496427 tempest-VolumesTestJSON-1783496427-project] Calling method '.version_select at 0x7fbab17bc790>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:52.226182 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-58a3b29d-b374-4534-9200-c13063dc77cd tempest-VolumesTestJSON-1783496427 tempest-VolumesTestJSON-1783496427-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.093411 Aug 06 14:31:52.227233 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 179/373] 10.222.0.17 () {58 vars in 1155 bytes} [Sat Aug 6 14:31:52 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:52.239688 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-d7ba7906-3547-4d85-9bd6-547903ddcec4 tempest-VolumesTestJSON-1783496427 tempest-VolumesTestJSON-1783496427-project] Calling method '.version_select at 0x7fbab0e148b0>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:52.291187 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-8d535a32-3c2c-48cc-ae03-cde52da406ed tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Action: 'create', calling method: .version_select at 0x7fbab17e0f70>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1034926031", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANPITkCs1G2bTU+gTEeFH77twndyQmWC3aTu3LUdUAerSdODCUdOupnTM33wK8NohKS/ZV7VS+camd6OqppHZkE1VzEXUkHoquGuO/zIEmdpE89kuLsLcSkcU1L+WlBJg=="}} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:31:52.309044 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.quota [None req-8d535a32-3c2c-48cc-ae03-cde52da406ed tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Getting quotas for project ca1a30d14e9a4c0ebd2fd8549a09ee44. Resources: {'key_pairs'} {{(pid=117838) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 14:31:52.313715 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.quota [None req-8d535a32-3c2c-48cc-ae03-cde52da406ed tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Getting quotas for user f96728f2ae5d4885858560396971a1b4 and project ca1a30d14e9a4c0ebd2fd8549a09ee44. Resources: {'key_pairs'} {{(pid=117838) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 14:31:52.337028 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-d7ba7906-3547-4d85-9bd6-547903ddcec4 tempest-VolumesTestJSON-1783496427 tempest-VolumesTestJSON-1783496427-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.101056 Aug 06 14:31:52.337914 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 195/374] 10.222.0.17 () {58 vars in 1188 bytes} [Sat Aug 6 14:31:52 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:31:52.350679 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-3115b623-a05f-48b6-b13b-71d95e0982d4 tempest-VolumesTestJSON-1783496427 tempest-VolumesTestJSON-1783496427-project] Calling method '.version_select at 0x7fbab0e17940>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:52.352460 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-8d535a32-3c2c-48cc-ae03-cde52da406ed tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.065213 Aug 06 14:31:52.353170 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 180/375] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Aug 6 14:31:52 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 14:31:52.471213 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-37395ea6-495e-4ff9-b286-fc2f2be10366 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1417345928", "imageRef": "42044332-90d9-4f0e-81f6-48551f994ba8", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1034926031", "networks": [{"uuid": "0e0e6121-bc47-40ea-8716-b8c087efc11a"}]}} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:31:52.529595 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.network.neutron [None req-37395ea6-495e-4ff9-b286-fc2f2be10366 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] validate_networks() for [('0e0e6121-bc47-40ea-8716-b8c087efc11a', None, None, None, None, None)] {{(pid=117838) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 14:31:52.576222 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-3115b623-a05f-48b6-b13b-71d95e0982d4 tempest-VolumesTestJSON-1783496427 tempest-VolumesTestJSON-1783496427-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.229375 Aug 06 14:31:52.576789 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 196/376] 10.222.0.17 () {58 vars in 1155 bytes} [Sat Aug 6 14:31:52 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:31:52.587193 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-194e9361-dfe1-44b5-b40a-bf70e20a69ec tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:52.587972 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-194e9361-dfe1-44b5-b40a-bf70e20a69ec tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] [instance: 81104a95-fe7a-4983-b5c5-2ad4d2463832] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:52.594610 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-194e9361-dfe1-44b5-b40a-bf70e20a69ec tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:52.595238 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-194e9361-dfe1-44b5-b40a-bf70e20a69ec tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:52.595555 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-194e9361-dfe1-44b5-b40a-bf70e20a69ec tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:52.596537 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-194e9361-dfe1-44b5-b40a-bf70e20a69ec tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:52.596845 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-194e9361-dfe1-44b5-b40a-bf70e20a69ec tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:52.597261 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-194e9361-dfe1-44b5-b40a-bf70e20a69ec tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:52.741107 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-194e9361-dfe1-44b5-b40a-bf70e20a69ec tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6f411ed91946eba54e46799edb12d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e7a9fef10f4aba994347a5d714f17f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:52.748532 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-194e9361-dfe1-44b5-b40a-bf70e20a69ec tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] 10.222.0.17 "GET /compute/v2.1/servers/81104a95-fe7a-4983-b5c5-2ad4d2463832" status: 200 len: 1319 microversion: 2.1 time: 0.166653 Aug 06 14:31:52.749090 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 197/377] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:52 2022] GET /compute/v2.1/servers/81104a95-fe7a-4983-b5c5-2ad4d2463832 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:52.926230 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.virt.hardware [None req-37395ea6-495e-4ff9-b286-fc2f2be10366 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Flavor limits 0:0:0 {{(pid=117838) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 14:31:52.926625 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.virt.hardware [None req-37395ea6-495e-4ff9-b286-fc2f2be10366 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Image limits 0:0:0 {{(pid=117838) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 14:31:52.927241 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.virt.hardware [None req-37395ea6-495e-4ff9-b286-fc2f2be10366 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Flavor pref 0:0:0 {{(pid=117838) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 14:31:52.928246 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.virt.hardware [None req-37395ea6-495e-4ff9-b286-fc2f2be10366 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Image pref 0:0:0 {{(pid=117838) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 14:31:52.928740 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.virt.hardware [None req-37395ea6-495e-4ff9-b286-fc2f2be10366 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117838) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 14:31:52.937790 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-37395ea6-495e-4ff9-b286-fc2f2be10366 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:52.938266 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-37395ea6-495e-4ff9-b286-fc2f2be10366 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:52.938691 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-37395ea6-495e-4ff9-b286-fc2f2be10366 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:52.939459 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-37395ea6-495e-4ff9-b286-fc2f2be10366 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:52.939909 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-37395ea6-495e-4ff9-b286-fc2f2be10366 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:52.940334 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-37395ea6-495e-4ff9-b286-fc2f2be10366 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:52.951814 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:31:52.959634 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.quota [None req-37395ea6-495e-4ff9-b286-fc2f2be10366 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Getting quotas for project ca1a30d14e9a4c0ebd2fd8549a09ee44. Resources: {'cores', 'instances', 'ram'} {{(pid=117838) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 14:31:52.964849 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.quota [None req-37395ea6-495e-4ff9-b286-fc2f2be10366 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Getting quotas for user f96728f2ae5d4885858560396971a1b4 and project ca1a30d14e9a4c0ebd2fd8549a09ee44. Resources: {'cores', 'instances', 'ram'} {{(pid=117838) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 14:31:52.976760 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-37395ea6-495e-4ff9-b286-fc2f2be10366 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Going to run 1 instances... {{(pid=117838) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 14:31:52.978986 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-37395ea6-495e-4ff9-b286-fc2f2be10366 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] [instance: cb14f0c5-5a75-4357-b1d3-78a2174cca02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='42044332-90d9-4f0e-81f6-48551f994ba8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117838) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 14:31:52.980171 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-a2c5a3f7-80f1-4e6b-9416-03b20d973a88 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:52.980834 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-a2c5a3f7-80f1-4e6b-9416-03b20d973a88 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: d1cbde5c-7d9e-49cc-ba65-31507c04c60b] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:52.986718 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a2c5a3f7-80f1-4e6b-9416-03b20d973a88 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:52.987227 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a2c5a3f7-80f1-4e6b-9416-03b20d973a88 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:52.987659 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a2c5a3f7-80f1-4e6b-9416-03b20d973a88 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:52.988337 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a2c5a3f7-80f1-4e6b-9416-03b20d973a88 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:52.988791 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a2c5a3f7-80f1-4e6b-9416-03b20d973a88 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:52.989564 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a2c5a3f7-80f1-4e6b-9416-03b20d973a88 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:53.023196 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-37395ea6-495e-4ff9-b286-fc2f2be10366 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.556456 Aug 06 14:31:53.024021 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 181/378] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Aug 6 14:31:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 558 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 06 14:31:53.034204 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-1b3c7468-ac76-4024-ab82-9e87dfd4806a tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:53.034818 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-1b3c7468-ac76-4024-ab82-9e87dfd4806a tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] [instance: cb14f0c5-5a75-4357-b1d3-78a2174cca02] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:53.094574 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-1b3c7468-ac76-4024-ab82-9e87dfd4806a tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96728f2ae5d4885858560396971a1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a30d14e9a4c0ebd2fd8549a09ee44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:53.103034 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-1b3c7468-ac76-4024-ab82-9e87dfd4806a tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] 10.222.0.17 "GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02" status: 200 len: 1259 microversion: 2.1 time: 0.072544 Aug 06 14:31:53.103605 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 182/379] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:53 2022] GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02 => generated 1259 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:31:53.135626 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-a2c5a3f7-80f1-4e6b-9416-03b20d973a88 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:53.143641 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-a2c5a3f7-80f1-4e6b-9416-03b20d973a88 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b" status: 200 len: 1522 microversion: 2.1 time: 0.167345 Aug 06 14:31:53.144204 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 198/380] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:52 2022] GET /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:31:53.769525 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-2c2727cf-ad33-46f4-8e7c-331d8419289c tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:53.770358 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-2c2727cf-ad33-46f4-8e7c-331d8419289c tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] [instance: 81104a95-fe7a-4983-b5c5-2ad4d2463832] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:53.776545 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2c2727cf-ad33-46f4-8e7c-331d8419289c tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:53.777027 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2c2727cf-ad33-46f4-8e7c-331d8419289c tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:53.777461 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2c2727cf-ad33-46f4-8e7c-331d8419289c tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:53.778153 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2c2727cf-ad33-46f4-8e7c-331d8419289c tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:53.778633 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2c2727cf-ad33-46f4-8e7c-331d8419289c tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:53.779163 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2c2727cf-ad33-46f4-8e7c-331d8419289c tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:53.914597 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-2c2727cf-ad33-46f4-8e7c-331d8419289c tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6f411ed91946eba54e46799edb12d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e7a9fef10f4aba994347a5d714f17f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:53.922012 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-2c2727cf-ad33-46f4-8e7c-331d8419289c tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] 10.222.0.17 "GET /compute/v2.1/servers/81104a95-fe7a-4983-b5c5-2ad4d2463832" status: 200 len: 1319 microversion: 2.1 time: 0.156403 Aug 06 14:31:53.922571 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 183/381] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:53 2022] GET /compute/v2.1/servers/81104a95-fe7a-4983-b5c5-2ad4d2463832 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:54.123944 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-1bb7dd33-d7c3-47c5-991b-ed809f07a453 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:54.125121 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-1bb7dd33-d7c3-47c5-991b-ed809f07a453 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] [instance: cb14f0c5-5a75-4357-b1d3-78a2174cca02] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:54.131398 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1bb7dd33-d7c3-47c5-991b-ed809f07a453 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:54.132134 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1bb7dd33-d7c3-47c5-991b-ed809f07a453 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:54.132651 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1bb7dd33-d7c3-47c5-991b-ed809f07a453 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:54.133370 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1bb7dd33-d7c3-47c5-991b-ed809f07a453 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:54.133986 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1bb7dd33-d7c3-47c5-991b-ed809f07a453 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:54.134564 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1bb7dd33-d7c3-47c5-991b-ed809f07a453 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:54.174776 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-b5790abf-35b3-4e2e-8147-a9ee9bf5a154 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:54.175974 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-b5790abf-35b3-4e2e-8147-a9ee9bf5a154 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: d1cbde5c-7d9e-49cc-ba65-31507c04c60b] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:54.185258 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b5790abf-35b3-4e2e-8147-a9ee9bf5a154 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:54.186413 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b5790abf-35b3-4e2e-8147-a9ee9bf5a154 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:54.187328 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b5790abf-35b3-4e2e-8147-a9ee9bf5a154 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:54.188277 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b5790abf-35b3-4e2e-8147-a9ee9bf5a154 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:54.188946 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b5790abf-35b3-4e2e-8147-a9ee9bf5a154 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:54.189808 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b5790abf-35b3-4e2e-8147-a9ee9bf5a154 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:54.245785 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-1bb7dd33-d7c3-47c5-991b-ed809f07a453 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96728f2ae5d4885858560396971a1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a30d14e9a4c0ebd2fd8549a09ee44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:54.262198 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-1bb7dd33-d7c3-47c5-991b-ed809f07a453 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] 10.222.0.17 "GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02" status: 200 len: 1319 microversion: 2.1 time: 0.141947 Aug 06 14:31:54.262793 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 199/382] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:54 2022] GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02 => generated 1319 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:54.425743 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-b5790abf-35b3-4e2e-8147-a9ee9bf5a154 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:54.433436 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-b5790abf-35b3-4e2e-8147-a9ee9bf5a154 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b" status: 200 len: 1522 microversion: 2.1 time: 0.269683 Aug 06 14:31:54.434294 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 184/383] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:54 2022] GET /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:54.942860 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-83940120-2694-4ea8-be45-9159df8592e0 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:54.944065 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-83940120-2694-4ea8-be45-9159df8592e0 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] [instance: 81104a95-fe7a-4983-b5c5-2ad4d2463832] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:54.957362 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-83940120-2694-4ea8-be45-9159df8592e0 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:54.957874 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-83940120-2694-4ea8-be45-9159df8592e0 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:54.958303 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-83940120-2694-4ea8-be45-9159df8592e0 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:54.959148 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-83940120-2694-4ea8-be45-9159df8592e0 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:54.959629 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-83940120-2694-4ea8-be45-9159df8592e0 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:54.960050 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-83940120-2694-4ea8-be45-9159df8592e0 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:55.212693 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-83940120-2694-4ea8-be45-9159df8592e0 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6f411ed91946eba54e46799edb12d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e7a9fef10f4aba994347a5d714f17f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:55.224459 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-83940120-2694-4ea8-be45-9159df8592e0 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] 10.222.0.17 "GET /compute/v2.1/servers/81104a95-fe7a-4983-b5c5-2ad4d2463832" status: 200 len: 1319 microversion: 2.1 time: 0.285261 Aug 06 14:31:55.225032 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 200/384] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:54 2022] GET /compute/v2.1/servers/81104a95-fe7a-4983-b5c5-2ad4d2463832 => generated 1319 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:55.284473 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-0cc65b5a-f352-4fa7-8d24-7e917cd59db2 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:55.285079 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-0cc65b5a-f352-4fa7-8d24-7e917cd59db2 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] [instance: cb14f0c5-5a75-4357-b1d3-78a2174cca02] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:55.291544 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0cc65b5a-f352-4fa7-8d24-7e917cd59db2 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:55.292030 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0cc65b5a-f352-4fa7-8d24-7e917cd59db2 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:55.292518 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0cc65b5a-f352-4fa7-8d24-7e917cd59db2 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:55.293242 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0cc65b5a-f352-4fa7-8d24-7e917cd59db2 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:55.293695 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0cc65b5a-f352-4fa7-8d24-7e917cd59db2 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:55.294116 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0cc65b5a-f352-4fa7-8d24-7e917cd59db2 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:55.462633 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-bc8c0db7-e5c5-43b0-9145-d6bab9400d16 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:55.463552 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-bc8c0db7-e5c5-43b0-9145-d6bab9400d16 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: d1cbde5c-7d9e-49cc-ba65-31507c04c60b] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:55.469128 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-0cc65b5a-f352-4fa7-8d24-7e917cd59db2 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96728f2ae5d4885858560396971a1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a30d14e9a4c0ebd2fd8549a09ee44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:55.471583 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-bc8c0db7-e5c5-43b0-9145-d6bab9400d16 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:55.472289 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-bc8c0db7-e5c5-43b0-9145-d6bab9400d16 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:55.473736 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-bc8c0db7-e5c5-43b0-9145-d6bab9400d16 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:55.474683 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-bc8c0db7-e5c5-43b0-9145-d6bab9400d16 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:55.475339 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-bc8c0db7-e5c5-43b0-9145-d6bab9400d16 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:55.475922 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-bc8c0db7-e5c5-43b0-9145-d6bab9400d16 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:55.487058 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-0cc65b5a-f352-4fa7-8d24-7e917cd59db2 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] 10.222.0.17 "GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02" status: 200 len: 1359 microversion: 2.1 time: 0.206400 Aug 06 14:31:55.488116 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 185/385] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:55 2022] GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02 => generated 1359 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:55.638275 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-bc8c0db7-e5c5-43b0-9145-d6bab9400d16 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:55.646303 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-bc8c0db7-e5c5-43b0-9145-d6bab9400d16 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b" status: 200 len: 1522 microversion: 2.1 time: 0.194844 Aug 06 14:31:55.646883 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 201/386] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:55 2022] GET /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:56.177951 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [req-e168fbdb-e617-4e90-a41b-0d28cffd5472 req-0a737572-3626-4508-aff4-3f0929afeac6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81104a95-fe7a-4983-b5c5-2ad4d2463832", "name": "network-vif-plugged", "status": "completed", "tag": "40e19162-8595-40db-9b52-bf0b15a595ec"}]} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:31:56.209700 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-e168fbdb-e617-4e90-a41b-0d28cffd5472 req-0a737572-3626-4508-aff4-3f0929afeac6 service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:56.210453 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-e168fbdb-e617-4e90-a41b-0d28cffd5472 req-0a737572-3626-4508-aff4-3f0929afeac6 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:56.212654 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-e168fbdb-e617-4e90-a41b-0d28cffd5472 req-0a737572-3626-4508-aff4-3f0929afeac6 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:56.223250 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:31:56.235127 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.compute.server_external_events [req-e168fbdb-e617-4e90-a41b-0d28cffd5472 req-0a737572-3626-4508-aff4-3f0929afeac6 service nova] Creating event network-vif-plugged:40e19162-8595-40db-9b52-bf0b15a595ec for instance 81104a95-fe7a-4983-b5c5-2ad4d2463832 on hv-cinder-85199 Aug 06 14:31:56.242703 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [req-e168fbdb-e617-4e90-a41b-0d28cffd5472 req-0a737572-3626-4508-aff4-3f0929afeac6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073126 Aug 06 14:31:56.243512 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 186/387] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:31:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:31:56.246570 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-26ba9e90-e82e-481c-b9ed-67cefbdf1e77 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:56.247510 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-26ba9e90-e82e-481c-b9ed-67cefbdf1e77 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] [instance: 81104a95-fe7a-4983-b5c5-2ad4d2463832] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:56.254766 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-26ba9e90-e82e-481c-b9ed-67cefbdf1e77 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:56.255724 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-26ba9e90-e82e-481c-b9ed-67cefbdf1e77 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:56.256229 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-26ba9e90-e82e-481c-b9ed-67cefbdf1e77 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:56.257060 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-26ba9e90-e82e-481c-b9ed-67cefbdf1e77 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:56.257971 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-26ba9e90-e82e-481c-b9ed-67cefbdf1e77 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:56.258482 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-26ba9e90-e82e-481c-b9ed-67cefbdf1e77 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:56.416978 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-26ba9e90-e82e-481c-b9ed-67cefbdf1e77 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6f411ed91946eba54e46799edb12d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e7a9fef10f4aba994347a5d714f17f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:56.425058 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-26ba9e90-e82e-481c-b9ed-67cefbdf1e77 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] 10.222.0.17 "GET /compute/v2.1/servers/81104a95-fe7a-4983-b5c5-2ad4d2463832" status: 200 len: 1319 microversion: 2.1 time: 0.183034 Aug 06 14:31:56.426192 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 202/388] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:56 2022] GET /compute/v2.1/servers/81104a95-fe7a-4983-b5c5-2ad4d2463832 => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:56.510010 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-d5d1cee1-d9ff-4178-ae78-19fbfd7d7dee tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:56.510724 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-d5d1cee1-d9ff-4178-ae78-19fbfd7d7dee tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] [instance: cb14f0c5-5a75-4357-b1d3-78a2174cca02] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:56.525454 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d5d1cee1-d9ff-4178-ae78-19fbfd7d7dee tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:56.526029 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d5d1cee1-d9ff-4178-ae78-19fbfd7d7dee tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:56.526530 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d5d1cee1-d9ff-4178-ae78-19fbfd7d7dee tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:56.527592 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d5d1cee1-d9ff-4178-ae78-19fbfd7d7dee tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:56.528237 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d5d1cee1-d9ff-4178-ae78-19fbfd7d7dee tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:56.528907 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d5d1cee1-d9ff-4178-ae78-19fbfd7d7dee tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:56.668216 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-7d87ac01-1bd9-4b91-9386-70e65f5f180f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:56.670606 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-7d87ac01-1bd9-4b91-9386-70e65f5f180f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: d1cbde5c-7d9e-49cc-ba65-31507c04c60b] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:56.678260 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7d87ac01-1bd9-4b91-9386-70e65f5f180f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:56.679338 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7d87ac01-1bd9-4b91-9386-70e65f5f180f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:56.680117 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7d87ac01-1bd9-4b91-9386-70e65f5f180f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:56.681460 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7d87ac01-1bd9-4b91-9386-70e65f5f180f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:56.682062 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7d87ac01-1bd9-4b91-9386-70e65f5f180f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:56.682652 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7d87ac01-1bd9-4b91-9386-70e65f5f180f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:56.692520 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-d5d1cee1-d9ff-4178-ae78-19fbfd7d7dee tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96728f2ae5d4885858560396971a1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a30d14e9a4c0ebd2fd8549a09ee44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:56.704202 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-d5d1cee1-d9ff-4178-ae78-19fbfd7d7dee tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] 10.222.0.17 "GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02" status: 200 len: 1359 microversion: 2.1 time: 0.198945 Aug 06 14:31:56.705137 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 187/389] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:56 2022] GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02 => generated 1359 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:56.941097 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-7d87ac01-1bd9-4b91-9386-70e65f5f180f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:56.957479 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-7d87ac01-1bd9-4b91-9386-70e65f5f180f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b" status: 200 len: 1522 microversion: 2.1 time: 0.293101 Aug 06 14:31:56.958058 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 203/390] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:56 2022] GET /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b => generated 1522 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:57.446407 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-eef2cec1-45f0-4c52-bd3e-fe8f8288d64c tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:57.447331 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-eef2cec1-45f0-4c52-bd3e-fe8f8288d64c tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] [instance: 81104a95-fe7a-4983-b5c5-2ad4d2463832] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:57.453572 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-eef2cec1-45f0-4c52-bd3e-fe8f8288d64c tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:57.454271 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-eef2cec1-45f0-4c52-bd3e-fe8f8288d64c tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:57.454858 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-eef2cec1-45f0-4c52-bd3e-fe8f8288d64c tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:57.455604 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-eef2cec1-45f0-4c52-bd3e-fe8f8288d64c tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:57.456055 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-eef2cec1-45f0-4c52-bd3e-fe8f8288d64c tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:57.456477 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-eef2cec1-45f0-4c52-bd3e-fe8f8288d64c tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:57.614037 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-eef2cec1-45f0-4c52-bd3e-fe8f8288d64c tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6f411ed91946eba54e46799edb12d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e7a9fef10f4aba994347a5d714f17f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:57.622561 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-eef2cec1-45f0-4c52-bd3e-fe8f8288d64c tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] 10.222.0.17 "GET /compute/v2.1/servers/81104a95-fe7a-4983-b5c5-2ad4d2463832" status: 200 len: 1319 microversion: 2.1 time: 0.180820 Aug 06 14:31:57.623190 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 188/391] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:57 2022] GET /compute/v2.1/servers/81104a95-fe7a-4983-b5c5-2ad4d2463832 => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:57.725448 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-8b3574a2-81cc-4c04-a4c4-e98571bf5069 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:57.726050 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-8b3574a2-81cc-4c04-a4c4-e98571bf5069 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] [instance: cb14f0c5-5a75-4357-b1d3-78a2174cca02] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:57.732680 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8b3574a2-81cc-4c04-a4c4-e98571bf5069 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:57.733163 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8b3574a2-81cc-4c04-a4c4-e98571bf5069 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:57.733593 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8b3574a2-81cc-4c04-a4c4-e98571bf5069 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:57.734282 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8b3574a2-81cc-4c04-a4c4-e98571bf5069 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:57.734727 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8b3574a2-81cc-4c04-a4c4-e98571bf5069 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:57.735166 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8b3574a2-81cc-4c04-a4c4-e98571bf5069 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:57.903508 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-8b3574a2-81cc-4c04-a4c4-e98571bf5069 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96728f2ae5d4885858560396971a1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a30d14e9a4c0ebd2fd8549a09ee44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:57.911652 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-8b3574a2-81cc-4c04-a4c4-e98571bf5069 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] 10.222.0.17 "GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02" status: 200 len: 1359 microversion: 2.1 time: 0.190303 Aug 06 14:31:57.913235 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 204/392] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:57 2022] GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02 => generated 1359 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:57.995219 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-af6945da-d4e7-419b-8e76-f94aa41d07ee tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:57.996957 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-af6945da-d4e7-419b-8e76-f94aa41d07ee tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: d1cbde5c-7d9e-49cc-ba65-31507c04c60b] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:58.014734 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-af6945da-d4e7-419b-8e76-f94aa41d07ee tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:58.019523 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-af6945da-d4e7-419b-8e76-f94aa41d07ee tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:58.021625 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-af6945da-d4e7-419b-8e76-f94aa41d07ee tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:58.023223 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-af6945da-d4e7-419b-8e76-f94aa41d07ee tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:58.024299 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-af6945da-d4e7-419b-8e76-f94aa41d07ee tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:58.025316 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-af6945da-d4e7-419b-8e76-f94aa41d07ee tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:58.200386 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-af6945da-d4e7-419b-8e76-f94aa41d07ee tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:58.208213 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-af6945da-d4e7-419b-8e76-f94aa41d07ee tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b" status: 200 len: 1522 microversion: 2.1 time: 0.231213 Aug 06 14:31:58.210914 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 189/393] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:57 2022] GET /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:58.643090 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-0d396a9a-57e6-4241-ab4f-9e39f916dbed tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:58.643639 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-0d396a9a-57e6-4241-ab4f-9e39f916dbed tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] [instance: 81104a95-fe7a-4983-b5c5-2ad4d2463832] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:58.650390 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0d396a9a-57e6-4241-ab4f-9e39f916dbed tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:58.650984 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0d396a9a-57e6-4241-ab4f-9e39f916dbed tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:58.651500 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0d396a9a-57e6-4241-ab4f-9e39f916dbed tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:58.652438 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0d396a9a-57e6-4241-ab4f-9e39f916dbed tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:58.653019 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0d396a9a-57e6-4241-ab4f-9e39f916dbed tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:58.653510 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0d396a9a-57e6-4241-ab4f-9e39f916dbed tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:58.813353 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-0d396a9a-57e6-4241-ab4f-9e39f916dbed tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6f411ed91946eba54e46799edb12d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e7a9fef10f4aba994347a5d714f17f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:58.821428 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-0d396a9a-57e6-4241-ab4f-9e39f916dbed tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] 10.222.0.17 "GET /compute/v2.1/servers/81104a95-fe7a-4983-b5c5-2ad4d2463832" status: 200 len: 1319 microversion: 2.1 time: 0.182339 Aug 06 14:31:58.821991 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 205/394] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:58 2022] GET /compute/v2.1/servers/81104a95-fe7a-4983-b5c5-2ad4d2463832 => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:58.934085 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-9bbcebe3-1221-43c6-83a5-6f542f389ee0 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:58.935058 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-9bbcebe3-1221-43c6-83a5-6f542f389ee0 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] [instance: cb14f0c5-5a75-4357-b1d3-78a2174cca02] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:58.956871 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9bbcebe3-1221-43c6-83a5-6f542f389ee0 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:58.957452 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9bbcebe3-1221-43c6-83a5-6f542f389ee0 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:58.958263 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9bbcebe3-1221-43c6-83a5-6f542f389ee0 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:58.959085 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9bbcebe3-1221-43c6-83a5-6f542f389ee0 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:58.959727 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9bbcebe3-1221-43c6-83a5-6f542f389ee0 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:58.960367 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9bbcebe3-1221-43c6-83a5-6f542f389ee0 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:59.139140 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-9bbcebe3-1221-43c6-83a5-6f542f389ee0 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96728f2ae5d4885858560396971a1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a30d14e9a4c0ebd2fd8549a09ee44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:59.152071 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-9bbcebe3-1221-43c6-83a5-6f542f389ee0 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] 10.222.0.17 "GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02" status: 200 len: 1359 microversion: 2.1 time: 0.220112 Aug 06 14:31:59.159062 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 190/395] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:58 2022] GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02 => generated 1359 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:59.229457 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-a1d7f64e-3803-4498-8c22-442a52b96740 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:59.230061 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-a1d7f64e-3803-4498-8c22-442a52b96740 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: d1cbde5c-7d9e-49cc-ba65-31507c04c60b] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:59.236061 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a1d7f64e-3803-4498-8c22-442a52b96740 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:59.236537 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a1d7f64e-3803-4498-8c22-442a52b96740 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:59.237006 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a1d7f64e-3803-4498-8c22-442a52b96740 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:59.237853 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a1d7f64e-3803-4498-8c22-442a52b96740 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:59.238347 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a1d7f64e-3803-4498-8c22-442a52b96740 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:59.238768 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a1d7f64e-3803-4498-8c22-442a52b96740 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:59.400092 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-a1d7f64e-3803-4498-8c22-442a52b96740 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:31:59.407700 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-a1d7f64e-3803-4498-8c22-442a52b96740 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b" status: 200 len: 1522 microversion: 2.1 time: 0.182036 Aug 06 14:31:59.408269 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 206/396] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:59 2022] GET /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:31:59.843908 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-38e200f8-0bc3-4da7-83fd-d2a6edc5d991 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:31:59.844522 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-38e200f8-0bc3-4da7-83fd-d2a6edc5d991 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] [instance: 81104a95-fe7a-4983-b5c5-2ad4d2463832] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:31:59.851820 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-38e200f8-0bc3-4da7-83fd-d2a6edc5d991 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:59.852294 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-38e200f8-0bc3-4da7-83fd-d2a6edc5d991 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:59.852728 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-38e200f8-0bc3-4da7-83fd-d2a6edc5d991 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:31:59.853612 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-38e200f8-0bc3-4da7-83fd-d2a6edc5d991 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:31:59.854075 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-38e200f8-0bc3-4da7-83fd-d2a6edc5d991 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:31:59.854505 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-38e200f8-0bc3-4da7-83fd-d2a6edc5d991 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:00.017887 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-38e200f8-0bc3-4da7-83fd-d2a6edc5d991 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6f411ed91946eba54e46799edb12d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e7a9fef10f4aba994347a5d714f17f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:32:00.035486 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-38e200f8-0bc3-4da7-83fd-d2a6edc5d991 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] 10.222.0.17 "GET /compute/v2.1/servers/81104a95-fe7a-4983-b5c5-2ad4d2463832" status: 200 len: 1319 microversion: 2.1 time: 0.196211 Aug 06 14:32:00.036065 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 191/397] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:31:59 2022] GET /compute/v2.1/servers/81104a95-fe7a-4983-b5c5-2ad4d2463832 => generated 1319 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:32:00.179062 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-31f8f388-16e6-46af-9c6a-31f03e276b7d tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:32:00.180316 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-31f8f388-16e6-46af-9c6a-31f03e276b7d tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] [instance: cb14f0c5-5a75-4357-b1d3-78a2174cca02] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:00.186902 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-31f8f388-16e6-46af-9c6a-31f03e276b7d tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:00.187700 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-31f8f388-16e6-46af-9c6a-31f03e276b7d tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:00.188305 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-31f8f388-16e6-46af-9c6a-31f03e276b7d tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:00.189012 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-31f8f388-16e6-46af-9c6a-31f03e276b7d tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:00.189467 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-31f8f388-16e6-46af-9c6a-31f03e276b7d tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:00.189894 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-31f8f388-16e6-46af-9c6a-31f03e276b7d tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:00.363147 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-31f8f388-16e6-46af-9c6a-31f03e276b7d tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96728f2ae5d4885858560396971a1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a30d14e9a4c0ebd2fd8549a09ee44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:32:00.379382 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-31f8f388-16e6-46af-9c6a-31f03e276b7d tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] 10.222.0.17 "GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02" status: 200 len: 1359 microversion: 2.1 time: 0.204106 Aug 06 14:32:00.379963 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 207/398] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:32:00 2022] GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02 => generated 1359 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:32:00.430512 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-e29a1c8e-f2d2-4a3f-9967-e1ea9a785841 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:32:00.431648 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-e29a1c8e-f2d2-4a3f-9967-e1ea9a785841 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: d1cbde5c-7d9e-49cc-ba65-31507c04c60b] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:00.437982 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e29a1c8e-f2d2-4a3f-9967-e1ea9a785841 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:00.438474 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e29a1c8e-f2d2-4a3f-9967-e1ea9a785841 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:00.438934 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e29a1c8e-f2d2-4a3f-9967-e1ea9a785841 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:00.439642 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e29a1c8e-f2d2-4a3f-9967-e1ea9a785841 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:00.441047 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e29a1c8e-f2d2-4a3f-9967-e1ea9a785841 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:00.441047 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e29a1c8e-f2d2-4a3f-9967-e1ea9a785841 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:00.618191 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-e29a1c8e-f2d2-4a3f-9967-e1ea9a785841 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:32:00.629085 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-e29a1c8e-f2d2-4a3f-9967-e1ea9a785841 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b" status: 200 len: 1522 microversion: 2.1 time: 0.202359 Aug 06 14:32:00.631250 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 192/399] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:32:00 2022] GET /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:32:01.059883 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-40eb432a-04d6-425a-8eef-a7bb9d14ee6d tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:32:01.061036 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-40eb432a-04d6-425a-8eef-a7bb9d14ee6d tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] [instance: 81104a95-fe7a-4983-b5c5-2ad4d2463832] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:01.067300 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-40eb432a-04d6-425a-8eef-a7bb9d14ee6d tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:01.068562 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-40eb432a-04d6-425a-8eef-a7bb9d14ee6d tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:01.069207 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-40eb432a-04d6-425a-8eef-a7bb9d14ee6d tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:01.069948 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-40eb432a-04d6-425a-8eef-a7bb9d14ee6d tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:01.070407 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-40eb432a-04d6-425a-8eef-a7bb9d14ee6d tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:01.070835 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-40eb432a-04d6-425a-8eef-a7bb9d14ee6d tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:01.232013 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-40eb432a-04d6-425a-8eef-a7bb9d14ee6d tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6f411ed91946eba54e46799edb12d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e7a9fef10f4aba994347a5d714f17f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:32:01.241257 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-40eb432a-04d6-425a-8eef-a7bb9d14ee6d tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] 10.222.0.17 "GET /compute/v2.1/servers/81104a95-fe7a-4983-b5c5-2ad4d2463832" status: 200 len: 1319 microversion: 2.1 time: 0.187725 Aug 06 14:32:01.242038 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 208/400] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:32:01 2022] GET /compute/v2.1/servers/81104a95-fe7a-4983-b5c5-2ad4d2463832 => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:32:01.401656 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-0efff7f5-1623-4b29-83cf-631a298f34e8 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:32:01.403786 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-0efff7f5-1623-4b29-83cf-631a298f34e8 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] [instance: cb14f0c5-5a75-4357-b1d3-78a2174cca02] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:01.413169 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0efff7f5-1623-4b29-83cf-631a298f34e8 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:01.414285 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0efff7f5-1623-4b29-83cf-631a298f34e8 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:01.414957 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0efff7f5-1623-4b29-83cf-631a298f34e8 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:01.415660 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0efff7f5-1623-4b29-83cf-631a298f34e8 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:01.416113 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0efff7f5-1623-4b29-83cf-631a298f34e8 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:01.416714 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0efff7f5-1623-4b29-83cf-631a298f34e8 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:01.560532 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-0efff7f5-1623-4b29-83cf-631a298f34e8 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96728f2ae5d4885858560396971a1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a30d14e9a4c0ebd2fd8549a09ee44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:32:01.567950 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-0efff7f5-1623-4b29-83cf-631a298f34e8 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] 10.222.0.17 "GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02" status: 200 len: 1359 microversion: 2.1 time: 0.171054 Aug 06 14:32:01.568506 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 193/401] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:32:01 2022] GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02 => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:32:01.653689 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-0352a831-5a05-4787-b95c-6142d54da144 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:32:01.654351 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-0352a831-5a05-4787-b95c-6142d54da144 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: d1cbde5c-7d9e-49cc-ba65-31507c04c60b] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:01.661060 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0352a831-5a05-4787-b95c-6142d54da144 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:01.662771 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0352a831-5a05-4787-b95c-6142d54da144 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:01.663356 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0352a831-5a05-4787-b95c-6142d54da144 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:01.664131 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0352a831-5a05-4787-b95c-6142d54da144 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:01.664662 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0352a831-5a05-4787-b95c-6142d54da144 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:01.665159 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0352a831-5a05-4787-b95c-6142d54da144 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:01.807676 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-0352a831-5a05-4787-b95c-6142d54da144 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:32:01.816675 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-0352a831-5a05-4787-b95c-6142d54da144 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b" status: 200 len: 1522 microversion: 2.1 time: 0.167905 Aug 06 14:32:01.818103 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 209/402] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:32:01 2022] GET /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:32:02.262141 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-889c4a04-e0dc-4f76-8667-04172e78c562 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:32:02.263102 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-889c4a04-e0dc-4f76-8667-04172e78c562 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] [instance: 81104a95-fe7a-4983-b5c5-2ad4d2463832] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:02.275272 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-889c4a04-e0dc-4f76-8667-04172e78c562 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:02.276013 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-889c4a04-e0dc-4f76-8667-04172e78c562 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:02.276631 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-889c4a04-e0dc-4f76-8667-04172e78c562 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:02.277663 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-889c4a04-e0dc-4f76-8667-04172e78c562 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:02.278547 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-889c4a04-e0dc-4f76-8667-04172e78c562 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:02.279266 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-889c4a04-e0dc-4f76-8667-04172e78c562 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:02.423148 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-889c4a04-e0dc-4f76-8667-04172e78c562 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6f411ed91946eba54e46799edb12d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e7a9fef10f4aba994347a5d714f17f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:32:02.431310 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-889c4a04-e0dc-4f76-8667-04172e78c562 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] 10.222.0.17 "GET /compute/v2.1/servers/81104a95-fe7a-4983-b5c5-2ad4d2463832" status: 200 len: 1319 microversion: 2.1 time: 0.172761 Aug 06 14:32:02.431871 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 194/403] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:32:02 2022] GET /compute/v2.1/servers/81104a95-fe7a-4983-b5c5-2ad4d2463832 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:32:02.589284 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-e14dec70-c738-4f3a-ae2f-54d26ad0220e tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:32:02.590031 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-e14dec70-c738-4f3a-ae2f-54d26ad0220e tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] [instance: cb14f0c5-5a75-4357-b1d3-78a2174cca02] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:02.595852 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e14dec70-c738-4f3a-ae2f-54d26ad0220e tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:02.596327 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e14dec70-c738-4f3a-ae2f-54d26ad0220e tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:02.596756 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e14dec70-c738-4f3a-ae2f-54d26ad0220e tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:02.597435 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e14dec70-c738-4f3a-ae2f-54d26ad0220e tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:02.597891 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e14dec70-c738-4f3a-ae2f-54d26ad0220e tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:02.598311 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e14dec70-c738-4f3a-ae2f-54d26ad0220e tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:02.729414 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-e14dec70-c738-4f3a-ae2f-54d26ad0220e tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96728f2ae5d4885858560396971a1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a30d14e9a4c0ebd2fd8549a09ee44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:32:02.734402 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_cell1:SELECT=100 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:32:02.743035 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-e14dec70-c738-4f3a-ae2f-54d26ad0220e tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] 10.222.0.17 "GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02" status: 200 len: 1359 microversion: 2.1 time: 0.157404 Aug 06 14:32:02.743620 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 210/404] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:32:02 2022] GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:32:02.837502 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-2ab209d3-3875-4459-8eac-5f9184149b28 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:32:02.838199 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-2ab209d3-3875-4459-8eac-5f9184149b28 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: d1cbde5c-7d9e-49cc-ba65-31507c04c60b] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:02.851018 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2ab209d3-3875-4459-8eac-5f9184149b28 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:02.851659 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2ab209d3-3875-4459-8eac-5f9184149b28 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:02.852205 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2ab209d3-3875-4459-8eac-5f9184149b28 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:02.852997 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2ab209d3-3875-4459-8eac-5f9184149b28 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:02.853546 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2ab209d3-3875-4459-8eac-5f9184149b28 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:02.854362 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2ab209d3-3875-4459-8eac-5f9184149b28 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:02.948125 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_cell0:SELECT=2 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:32:02.988505 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-2ab209d3-3875-4459-8eac-5f9184149b28 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:32:02.996098 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-2ab209d3-3875-4459-8eac-5f9184149b28 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b" status: 200 len: 1522 microversion: 2.1 time: 0.162422 Aug 06 14:32:02.996657 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 195/405] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:32:02 2022] GET /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:32:03.451801 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-a29ea0ba-d31d-45da-9695-cbd72e4f07ac tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:32:03.452426 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-a29ea0ba-d31d-45da-9695-cbd72e4f07ac tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] [instance: 81104a95-fe7a-4983-b5c5-2ad4d2463832] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:03.458861 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a29ea0ba-d31d-45da-9695-cbd72e4f07ac tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:03.459621 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a29ea0ba-d31d-45da-9695-cbd72e4f07ac tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:03.460097 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a29ea0ba-d31d-45da-9695-cbd72e4f07ac tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:03.460780 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a29ea0ba-d31d-45da-9695-cbd72e4f07ac tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:03.461232 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a29ea0ba-d31d-45da-9695-cbd72e4f07ac tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:03.461654 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a29ea0ba-d31d-45da-9695-cbd72e4f07ac tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:03.598382 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-a29ea0ba-d31d-45da-9695-cbd72e4f07ac tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6f411ed91946eba54e46799edb12d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e7a9fef10f4aba994347a5d714f17f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:32:03.606349 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-a29ea0ba-d31d-45da-9695-cbd72e4f07ac tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] 10.222.0.17 "GET /compute/v2.1/servers/81104a95-fe7a-4983-b5c5-2ad4d2463832" status: 200 len: 1319 microversion: 2.1 time: 0.158557 Aug 06 14:32:03.606925 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 211/406] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:32:03 2022] GET /compute/v2.1/servers/81104a95-fe7a-4983-b5c5-2ad4d2463832 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:32:03.763561 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-84dba9d1-aeda-4c10-98de-f37c0224c7a9 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:32:03.764172 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-84dba9d1-aeda-4c10-98de-f37c0224c7a9 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] [instance: cb14f0c5-5a75-4357-b1d3-78a2174cca02] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:03.766024 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_cell0:SELECT=12 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:32:03.772057 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-84dba9d1-aeda-4c10-98de-f37c0224c7a9 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:03.772543 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-84dba9d1-aeda-4c10-98de-f37c0224c7a9 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:03.772980 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-84dba9d1-aeda-4c10-98de-f37c0224c7a9 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:03.773672 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-84dba9d1-aeda-4c10-98de-f37c0224c7a9 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:03.774125 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-84dba9d1-aeda-4c10-98de-f37c0224c7a9 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:03.774552 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-84dba9d1-aeda-4c10-98de-f37c0224c7a9 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:03.912541 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-84dba9d1-aeda-4c10-98de-f37c0224c7a9 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96728f2ae5d4885858560396971a1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a30d14e9a4c0ebd2fd8549a09ee44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:32:03.920313 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-84dba9d1-aeda-4c10-98de-f37c0224c7a9 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] 10.222.0.17 "GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02" status: 200 len: 1359 microversion: 2.1 time: 0.160594 Aug 06 14:32:03.921188 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 196/407] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:32:03 2022] GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:32:04.017427 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-5b986241-65d8-4e96-a348-ea992c471cc3 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:32:04.018033 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-5b986241-65d8-4e96-a348-ea992c471cc3 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: d1cbde5c-7d9e-49cc-ba65-31507c04c60b] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:04.024646 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-5b986241-65d8-4e96-a348-ea992c471cc3 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:04.025223 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-5b986241-65d8-4e96-a348-ea992c471cc3 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:04.025767 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-5b986241-65d8-4e96-a348-ea992c471cc3 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:04.026532 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-5b986241-65d8-4e96-a348-ea992c471cc3 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:04.027079 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-5b986241-65d8-4e96-a348-ea992c471cc3 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:04.027507 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-5b986241-65d8-4e96-a348-ea992c471cc3 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:04.162657 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-5b986241-65d8-4e96-a348-ea992c471cc3 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:32:04.170411 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-5b986241-65d8-4e96-a348-ea992c471cc3 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b" status: 200 len: 1522 microversion: 2.1 time: 0.156728 Aug 06 14:32:04.171265 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 212/408] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:32:04 2022] GET /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:32:04.628015 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-d097039d-451d-4cb0-a10b-8bebae9b2c6c tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:32:04.628718 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-d097039d-451d-4cb0-a10b-8bebae9b2c6c tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] [instance: 81104a95-fe7a-4983-b5c5-2ad4d2463832] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:04.635502 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d097039d-451d-4cb0-a10b-8bebae9b2c6c tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:04.635992 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d097039d-451d-4cb0-a10b-8bebae9b2c6c tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:04.636430 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d097039d-451d-4cb0-a10b-8bebae9b2c6c tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:04.637136 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d097039d-451d-4cb0-a10b-8bebae9b2c6c tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:04.637592 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d097039d-451d-4cb0-a10b-8bebae9b2c6c tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:04.638021 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d097039d-451d-4cb0-a10b-8bebae9b2c6c tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:04.796873 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-d097039d-451d-4cb0-a10b-8bebae9b2c6c tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6f411ed91946eba54e46799edb12d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e7a9fef10f4aba994347a5d714f17f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:32:04.806674 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-d097039d-451d-4cb0-a10b-8bebae9b2c6c tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] 10.222.0.17 "GET /compute/v2.1/servers/81104a95-fe7a-4983-b5c5-2ad4d2463832" status: 200 len: 1319 microversion: 2.1 time: 0.183057 Aug 06 14:32:04.807290 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 197/409] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:32:04 2022] GET /compute/v2.1/servers/81104a95-fe7a-4983-b5c5-2ad4d2463832 => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:32:04.943701 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-498ee042-3a1c-4b53-8c16-0ff52e3190b0 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:32:04.945123 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-498ee042-3a1c-4b53-8c16-0ff52e3190b0 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] [instance: cb14f0c5-5a75-4357-b1d3-78a2174cca02] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:04.948078 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_api:SELECT=66 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:32:04.951755 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-498ee042-3a1c-4b53-8c16-0ff52e3190b0 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:04.952282 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-498ee042-3a1c-4b53-8c16-0ff52e3190b0 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:04.952791 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-498ee042-3a1c-4b53-8c16-0ff52e3190b0 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:04.953655 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-498ee042-3a1c-4b53-8c16-0ff52e3190b0 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:04.954107 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-498ee042-3a1c-4b53-8c16-0ff52e3190b0 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:04.954525 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-498ee042-3a1c-4b53-8c16-0ff52e3190b0 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:05.122460 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-498ee042-3a1c-4b53-8c16-0ff52e3190b0 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96728f2ae5d4885858560396971a1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a30d14e9a4c0ebd2fd8549a09ee44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:32:05.132772 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-498ee042-3a1c-4b53-8c16-0ff52e3190b0 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] 10.222.0.17 "GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02" status: 200 len: 1359 microversion: 2.1 time: 0.194668 Aug 06 14:32:05.137444 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 213/410] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:32:04 2022] GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02 => generated 1359 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:32:05.191887 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-8b96ba9a-c55a-4209-bef7-7c6ac2f9ba1a tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:32:05.192745 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-8b96ba9a-c55a-4209-bef7-7c6ac2f9ba1a tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: d1cbde5c-7d9e-49cc-ba65-31507c04c60b] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:05.199814 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8b96ba9a-c55a-4209-bef7-7c6ac2f9ba1a tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:05.200455 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8b96ba9a-c55a-4209-bef7-7c6ac2f9ba1a tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:05.201183 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8b96ba9a-c55a-4209-bef7-7c6ac2f9ba1a tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:05.202205 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8b96ba9a-c55a-4209-bef7-7c6ac2f9ba1a tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:05.202929 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8b96ba9a-c55a-4209-bef7-7c6ac2f9ba1a tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:05.203561 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8b96ba9a-c55a-4209-bef7-7c6ac2f9ba1a tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:05.362352 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-8b96ba9a-c55a-4209-bef7-7c6ac2f9ba1a tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:32:05.374183 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-8b96ba9a-c55a-4209-bef7-7c6ac2f9ba1a tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b" status: 200 len: 1522 microversion: 2.1 time: 0.186595 Aug 06 14:32:05.374831 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 198/411] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:32:05 2022] GET /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:32:05.829208 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-d86f0cc4-613a-4317-87b4-3f28171c7d17 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:32:05.829896 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-d86f0cc4-613a-4317-87b4-3f28171c7d17 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] [instance: 81104a95-fe7a-4983-b5c5-2ad4d2463832] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:05.836861 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d86f0cc4-613a-4317-87b4-3f28171c7d17 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:05.837342 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d86f0cc4-613a-4317-87b4-3f28171c7d17 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:05.837772 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d86f0cc4-613a-4317-87b4-3f28171c7d17 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:05.838464 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d86f0cc4-613a-4317-87b4-3f28171c7d17 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:05.838938 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d86f0cc4-613a-4317-87b4-3f28171c7d17 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:05.839361 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d86f0cc4-613a-4317-87b4-3f28171c7d17 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:05.966111 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-d86f0cc4-613a-4317-87b4-3f28171c7d17 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6f411ed91946eba54e46799edb12d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e7a9fef10f4aba994347a5d714f17f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:32:05.973544 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-d86f0cc4-613a-4317-87b4-3f28171c7d17 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] 10.222.0.17 "GET /compute/v2.1/servers/81104a95-fe7a-4983-b5c5-2ad4d2463832" status: 200 len: 1319 microversion: 2.1 time: 0.149198 Aug 06 14:32:05.974113 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 214/412] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:32:05 2022] GET /compute/v2.1/servers/81104a95-fe7a-4983-b5c5-2ad4d2463832 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:32:06.157729 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-9a112fb5-2d97-4492-a518-f185726ac51c tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:32:06.158371 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-9a112fb5-2d97-4492-a518-f185726ac51c tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] [instance: cb14f0c5-5a75-4357-b1d3-78a2174cca02] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:06.164765 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9a112fb5-2d97-4492-a518-f185726ac51c tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:06.165274 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9a112fb5-2d97-4492-a518-f185726ac51c tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:06.165707 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9a112fb5-2d97-4492-a518-f185726ac51c tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:06.166395 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9a112fb5-2d97-4492-a518-f185726ac51c tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:06.166850 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9a112fb5-2d97-4492-a518-f185726ac51c tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:06.167301 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9a112fb5-2d97-4492-a518-f185726ac51c tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:06.298302 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-9a112fb5-2d97-4492-a518-f185726ac51c tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96728f2ae5d4885858560396971a1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a30d14e9a4c0ebd2fd8549a09ee44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:32:06.306413 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-9a112fb5-2d97-4492-a518-f185726ac51c tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] 10.222.0.17 "GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02" status: 200 len: 1359 microversion: 2.1 time: 0.152541 Aug 06 14:32:06.306982 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 199/413] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:32:06 2022] GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:32:06.395357 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-0551dd99-0e4e-4cfe-9d5b-f1d0bb56f9aa tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:32:06.396017 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-0551dd99-0e4e-4cfe-9d5b-f1d0bb56f9aa tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: d1cbde5c-7d9e-49cc-ba65-31507c04c60b] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:06.401827 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0551dd99-0e4e-4cfe-9d5b-f1d0bb56f9aa tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:06.402308 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0551dd99-0e4e-4cfe-9d5b-f1d0bb56f9aa tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:06.402739 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0551dd99-0e4e-4cfe-9d5b-f1d0bb56f9aa tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:06.403451 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0551dd99-0e4e-4cfe-9d5b-f1d0bb56f9aa tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:06.403903 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0551dd99-0e4e-4cfe-9d5b-f1d0bb56f9aa tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:06.404323 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0551dd99-0e4e-4cfe-9d5b-f1d0bb56f9aa tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:06.540556 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-0551dd99-0e4e-4cfe-9d5b-f1d0bb56f9aa tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:32:06.548626 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-0551dd99-0e4e-4cfe-9d5b-f1d0bb56f9aa tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b" status: 200 len: 1522 microversion: 2.1 time: 0.157096 Aug 06 14:32:06.549488 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 215/414] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:32:06 2022] GET /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:32:06.994204 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-db89bcc2-1e8d-46fc-81b1-cb5594058263 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:32:06.994809 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-db89bcc2-1e8d-46fc-81b1-cb5594058263 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] [instance: 81104a95-fe7a-4983-b5c5-2ad4d2463832] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:07.000873 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-db89bcc2-1e8d-46fc-81b1-cb5594058263 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:07.001349 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-db89bcc2-1e8d-46fc-81b1-cb5594058263 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:07.001776 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-db89bcc2-1e8d-46fc-81b1-cb5594058263 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:07.002455 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-db89bcc2-1e8d-46fc-81b1-cb5594058263 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:07.002920 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-db89bcc2-1e8d-46fc-81b1-cb5594058263 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:07.003342 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-db89bcc2-1e8d-46fc-81b1-cb5594058263 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:07.135064 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-db89bcc2-1e8d-46fc-81b1-cb5594058263 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6f411ed91946eba54e46799edb12d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e7a9fef10f4aba994347a5d714f17f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:32:07.142743 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-db89bcc2-1e8d-46fc-81b1-cb5594058263 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] 10.222.0.17 "GET /compute/v2.1/servers/81104a95-fe7a-4983-b5c5-2ad4d2463832" status: 200 len: 1319 microversion: 2.1 time: 0.152805 Aug 06 14:32:07.143328 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 200/415] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:32:06 2022] GET /compute/v2.1/servers/81104a95-fe7a-4983-b5c5-2ad4d2463832 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:32:07.327251 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-39fb466b-301a-4433-9633-becb3070b51b tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:32:07.328107 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-39fb466b-301a-4433-9633-becb3070b51b tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] [instance: cb14f0c5-5a75-4357-b1d3-78a2174cca02] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:07.334808 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-39fb466b-301a-4433-9633-becb3070b51b tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:07.335507 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-39fb466b-301a-4433-9633-becb3070b51b tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:07.335932 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-39fb466b-301a-4433-9633-becb3070b51b tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:07.336783 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-39fb466b-301a-4433-9633-becb3070b51b tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:07.337229 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-39fb466b-301a-4433-9633-becb3070b51b tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:07.337789 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-39fb466b-301a-4433-9633-becb3070b51b tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:07.478621 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-39fb466b-301a-4433-9633-becb3070b51b tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96728f2ae5d4885858560396971a1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a30d14e9a4c0ebd2fd8549a09ee44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:32:07.486807 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-39fb466b-301a-4433-9633-becb3070b51b tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] 10.222.0.17 "GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02" status: 200 len: 1359 microversion: 2.1 time: 0.163311 Aug 06 14:32:07.487420 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 216/416] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:32:07 2022] GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:32:07.573480 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-ec8dfd41-09a0-4136-9a0e-c313d070aeb5 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:32:07.574108 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-ec8dfd41-09a0-4136-9a0e-c313d070aeb5 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: d1cbde5c-7d9e-49cc-ba65-31507c04c60b] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:07.582751 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ec8dfd41-09a0-4136-9a0e-c313d070aeb5 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:07.583270 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ec8dfd41-09a0-4136-9a0e-c313d070aeb5 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:07.583706 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ec8dfd41-09a0-4136-9a0e-c313d070aeb5 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:07.587535 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ec8dfd41-09a0-4136-9a0e-c313d070aeb5 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:07.588195 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ec8dfd41-09a0-4136-9a0e-c313d070aeb5 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:07.588937 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ec8dfd41-09a0-4136-9a0e-c313d070aeb5 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:07.787396 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-ec8dfd41-09a0-4136-9a0e-c313d070aeb5 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:32:07.795296 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-ec8dfd41-09a0-4136-9a0e-c313d070aeb5 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b" status: 200 len: 1522 microversion: 2.1 time: 0.226099 Aug 06 14:32:07.796049 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 201/417] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:32:07 2022] GET /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:32:08.165359 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-2123edb9-8954-41f8-a748-bc5cc3d733eb tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:32:08.165992 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-2123edb9-8954-41f8-a748-bc5cc3d733eb tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] [instance: 81104a95-fe7a-4983-b5c5-2ad4d2463832] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:08.171868 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2123edb9-8954-41f8-a748-bc5cc3d733eb tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:08.172349 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2123edb9-8954-41f8-a748-bc5cc3d733eb tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:08.172791 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2123edb9-8954-41f8-a748-bc5cc3d733eb tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:08.173501 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2123edb9-8954-41f8-a748-bc5cc3d733eb tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:08.173952 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2123edb9-8954-41f8-a748-bc5cc3d733eb tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:08.174398 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2123edb9-8954-41f8-a748-bc5cc3d733eb tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:08.311048 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-2123edb9-8954-41f8-a748-bc5cc3d733eb tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6f411ed91946eba54e46799edb12d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e7a9fef10f4aba994347a5d714f17f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:32:08.318518 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-2123edb9-8954-41f8-a748-bc5cc3d733eb tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] 10.222.0.17 "GET /compute/v2.1/servers/81104a95-fe7a-4983-b5c5-2ad4d2463832" status: 200 len: 1319 microversion: 2.1 time: 0.157692 Aug 06 14:32:08.319160 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 217/418] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:32:08 2022] GET /compute/v2.1/servers/81104a95-fe7a-4983-b5c5-2ad4d2463832 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:32:08.509202 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-adf82c3a-ebb1-4569-bbf7-ee73a570ef70 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:32:08.510689 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-adf82c3a-ebb1-4569-bbf7-ee73a570ef70 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] [instance: cb14f0c5-5a75-4357-b1d3-78a2174cca02] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:08.516573 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-adf82c3a-ebb1-4569-bbf7-ee73a570ef70 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:08.517042 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-adf82c3a-ebb1-4569-bbf7-ee73a570ef70 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:08.517467 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-adf82c3a-ebb1-4569-bbf7-ee73a570ef70 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:08.518148 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-adf82c3a-ebb1-4569-bbf7-ee73a570ef70 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:08.518595 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-adf82c3a-ebb1-4569-bbf7-ee73a570ef70 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:08.519034 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-adf82c3a-ebb1-4569-bbf7-ee73a570ef70 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:08.653447 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-adf82c3a-ebb1-4569-bbf7-ee73a570ef70 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96728f2ae5d4885858560396971a1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a30d14e9a4c0ebd2fd8549a09ee44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:32:08.660804 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-adf82c3a-ebb1-4569-bbf7-ee73a570ef70 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] 10.222.0.17 "GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02" status: 200 len: 1359 microversion: 2.1 time: 0.155641 Aug 06 14:32:08.661402 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 202/419] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:32:08 2022] GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:32:08.817073 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-2f47ff10-8393-4a54-b3ec-f7684fafcb5b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:32:08.818804 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-2f47ff10-8393-4a54-b3ec-f7684fafcb5b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: d1cbde5c-7d9e-49cc-ba65-31507c04c60b] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:08.825601 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2f47ff10-8393-4a54-b3ec-f7684fafcb5b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:08.826413 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2f47ff10-8393-4a54-b3ec-f7684fafcb5b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:08.826781 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2f47ff10-8393-4a54-b3ec-f7684fafcb5b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:08.827828 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2f47ff10-8393-4a54-b3ec-f7684fafcb5b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:08.828417 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2f47ff10-8393-4a54-b3ec-f7684fafcb5b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:08.829029 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2f47ff10-8393-4a54-b3ec-f7684fafcb5b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:09.221046 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-2f47ff10-8393-4a54-b3ec-f7684fafcb5b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:32:09.229405 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-2f47ff10-8393-4a54-b3ec-f7684fafcb5b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b" status: 200 len: 1522 microversion: 2.1 time: 0.416564 Aug 06 14:32:09.230134 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 218/420] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:32:08 2022] GET /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b => generated 1522 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:32:09.339431 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-1d7b8f58-69cb-41ad-9ef6-dd455af19f6b tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:32:09.340232 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-1d7b8f58-69cb-41ad-9ef6-dd455af19f6b tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] [instance: 81104a95-fe7a-4983-b5c5-2ad4d2463832] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:09.347671 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1d7b8f58-69cb-41ad-9ef6-dd455af19f6b tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:09.348091 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1d7b8f58-69cb-41ad-9ef6-dd455af19f6b tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:09.348530 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1d7b8f58-69cb-41ad-9ef6-dd455af19f6b tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:09.349586 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1d7b8f58-69cb-41ad-9ef6-dd455af19f6b tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:09.350056 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1d7b8f58-69cb-41ad-9ef6-dd455af19f6b tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:09.350634 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1d7b8f58-69cb-41ad-9ef6-dd455af19f6b tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:09.367228 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_cell1:SELECT=100 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:32:09.619865 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-1d7b8f58-69cb-41ad-9ef6-dd455af19f6b tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6f411ed91946eba54e46799edb12d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e7a9fef10f4aba994347a5d714f17f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:32:09.632212 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-1d7b8f58-69cb-41ad-9ef6-dd455af19f6b tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] 10.222.0.17 "GET /compute/v2.1/servers/81104a95-fe7a-4983-b5c5-2ad4d2463832" status: 200 len: 1319 microversion: 2.1 time: 0.296874 Aug 06 14:32:09.633263 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 203/421] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:32:09 2022] GET /compute/v2.1/servers/81104a95-fe7a-4983-b5c5-2ad4d2463832 => generated 1319 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:32:09.682699 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-6fe5201e-518d-424c-ba8b-ce92c997251e tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:32:09.683811 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-6fe5201e-518d-424c-ba8b-ce92c997251e tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] [instance: cb14f0c5-5a75-4357-b1d3-78a2174cca02] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:09.689737 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6fe5201e-518d-424c-ba8b-ce92c997251e tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:09.690317 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6fe5201e-518d-424c-ba8b-ce92c997251e tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:09.690986 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6fe5201e-518d-424c-ba8b-ce92c997251e tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:09.691687 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6fe5201e-518d-424c-ba8b-ce92c997251e tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:09.692146 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6fe5201e-518d-424c-ba8b-ce92c997251e tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:09.692618 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6fe5201e-518d-424c-ba8b-ce92c997251e tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:09.834429 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-6fe5201e-518d-424c-ba8b-ce92c997251e tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96728f2ae5d4885858560396971a1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a30d14e9a4c0ebd2fd8549a09ee44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:32:09.846157 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-6fe5201e-518d-424c-ba8b-ce92c997251e tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] 10.222.0.17 "GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02" status: 200 len: 1359 microversion: 2.1 time: 0.167399 Aug 06 14:32:09.849778 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 219/422] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:32:09 2022] GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02 => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:32:09.880575 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [req-202250e8-7715-472b-a598-62ed7008ebaf req-226deeb3-1864-486b-b35a-bc47e1efcca0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb14f0c5-5a75-4357-b1d3-78a2174cca02", "tag": "0bc19d76-ece6-4342-a828-3e88712b2b00"}]} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:32:09.890028 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-202250e8-7715-472b-a598-62ed7008ebaf req-226deeb3-1864-486b-b35a-bc47e1efcca0 service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:09.890804 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-202250e8-7715-472b-a598-62ed7008ebaf req-226deeb3-1864-486b-b35a-bc47e1efcca0 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:09.891324 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-202250e8-7715-472b-a598-62ed7008ebaf req-226deeb3-1864-486b-b35a-bc47e1efcca0 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:09.903344 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.compute.server_external_events [req-202250e8-7715-472b-a598-62ed7008ebaf req-226deeb3-1864-486b-b35a-bc47e1efcca0 service nova] Creating event network-changed:0bc19d76-ece6-4342-a828-3e88712b2b00 for instance cb14f0c5-5a75-4357-b1d3-78a2174cca02 on hv-cinder-85199 Aug 06 14:32:09.908419 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [req-202250e8-7715-472b-a598-62ed7008ebaf req-226deeb3-1864-486b-b35a-bc47e1efcca0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031557 Aug 06 14:32:09.909118 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 204/423] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:32:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:32:10.250255 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-21f47ce8-443b-4c70-bc48-ad3c89aca421 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:32:10.250785 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-21f47ce8-443b-4c70-bc48-ad3c89aca421 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: d1cbde5c-7d9e-49cc-ba65-31507c04c60b] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:10.257323 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-21f47ce8-443b-4c70-bc48-ad3c89aca421 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:10.257795 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-21f47ce8-443b-4c70-bc48-ad3c89aca421 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:10.258218 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-21f47ce8-443b-4c70-bc48-ad3c89aca421 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:10.258916 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-21f47ce8-443b-4c70-bc48-ad3c89aca421 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:10.259366 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-21f47ce8-443b-4c70-bc48-ad3c89aca421 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:10.259782 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-21f47ce8-443b-4c70-bc48-ad3c89aca421 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:10.389235 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-21f47ce8-443b-4c70-bc48-ad3c89aca421 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:32:10.397264 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-21f47ce8-443b-4c70-bc48-ad3c89aca421 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b" status: 200 len: 1522 microversion: 2.1 time: 0.151001 Aug 06 14:32:10.397820 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 220/424] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:32:10 2022] GET /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:32:10.654852 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-07777e97-6005-4f80-a23a-e6265a56da66 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:32:10.655599 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-07777e97-6005-4f80-a23a-e6265a56da66 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] [instance: 81104a95-fe7a-4983-b5c5-2ad4d2463832] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:10.662341 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-07777e97-6005-4f80-a23a-e6265a56da66 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:10.662818 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-07777e97-6005-4f80-a23a-e6265a56da66 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:10.663275 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-07777e97-6005-4f80-a23a-e6265a56da66 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:10.663955 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-07777e97-6005-4f80-a23a-e6265a56da66 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:10.664405 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-07777e97-6005-4f80-a23a-e6265a56da66 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:10.664825 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-07777e97-6005-4f80-a23a-e6265a56da66 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:10.823997 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-07777e97-6005-4f80-a23a-e6265a56da66 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6f411ed91946eba54e46799edb12d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e7a9fef10f4aba994347a5d714f17f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:32:10.831291 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-07777e97-6005-4f80-a23a-e6265a56da66 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] 10.222.0.17 "GET /compute/v2.1/servers/81104a95-fe7a-4983-b5c5-2ad4d2463832" status: 200 len: 1319 microversion: 2.1 time: 0.181088 Aug 06 14:32:10.831841 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 205/425] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:32:10 2022] GET /compute/v2.1/servers/81104a95-fe7a-4983-b5c5-2ad4d2463832 => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:32:10.870091 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-ad4fa453-31a4-48ea-8a65-de248987333b tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:32:10.870702 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-ad4fa453-31a4-48ea-8a65-de248987333b tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] [instance: cb14f0c5-5a75-4357-b1d3-78a2174cca02] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:10.876656 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ad4fa453-31a4-48ea-8a65-de248987333b tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:10.877138 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ad4fa453-31a4-48ea-8a65-de248987333b tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:10.877571 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ad4fa453-31a4-48ea-8a65-de248987333b tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:10.878282 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ad4fa453-31a4-48ea-8a65-de248987333b tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:10.878739 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ad4fa453-31a4-48ea-8a65-de248987333b tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:10.879372 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ad4fa453-31a4-48ea-8a65-de248987333b tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:11.024099 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-ad4fa453-31a4-48ea-8a65-de248987333b tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96728f2ae5d4885858560396971a1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a30d14e9a4c0ebd2fd8549a09ee44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:32:11.031636 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-ad4fa453-31a4-48ea-8a65-de248987333b tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] 10.222.0.17 "GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02" status: 200 len: 1359 microversion: 2.1 time: 0.165538 Aug 06 14:32:11.032198 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 221/426] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:32:10 2022] GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:32:11.418225 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-1e6c754a-eda1-4f89-a5cc-1536d6064360 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:32:11.419091 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-1e6c754a-eda1-4f89-a5cc-1536d6064360 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: d1cbde5c-7d9e-49cc-ba65-31507c04c60b] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:11.424910 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1e6c754a-eda1-4f89-a5cc-1536d6064360 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:11.425397 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1e6c754a-eda1-4f89-a5cc-1536d6064360 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:11.425837 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1e6c754a-eda1-4f89-a5cc-1536d6064360 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:11.426533 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1e6c754a-eda1-4f89-a5cc-1536d6064360 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:11.427021 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1e6c754a-eda1-4f89-a5cc-1536d6064360 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:11.427449 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1e6c754a-eda1-4f89-a5cc-1536d6064360 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:11.563602 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-1e6c754a-eda1-4f89-a5cc-1536d6064360 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:32:11.572191 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-1e6c754a-eda1-4f89-a5cc-1536d6064360 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b" status: 200 len: 1522 microversion: 2.1 time: 0.157740 Aug 06 14:32:11.572896 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 206/427] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:32:11 2022] GET /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:32:11.852809 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-543ae5f1-f70d-41c4-b731-ea2e804feb5e tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:32:11.853412 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-543ae5f1-f70d-41c4-b731-ea2e804feb5e tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] [instance: 81104a95-fe7a-4983-b5c5-2ad4d2463832] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:11.859192 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-543ae5f1-f70d-41c4-b731-ea2e804feb5e tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:11.859670 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-543ae5f1-f70d-41c4-b731-ea2e804feb5e tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:11.860246 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-543ae5f1-f70d-41c4-b731-ea2e804feb5e tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:11.860932 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-543ae5f1-f70d-41c4-b731-ea2e804feb5e tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:11.861384 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-543ae5f1-f70d-41c4-b731-ea2e804feb5e tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:11.861803 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-543ae5f1-f70d-41c4-b731-ea2e804feb5e tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:12.002241 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-543ae5f1-f70d-41c4-b731-ea2e804feb5e tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6f411ed91946eba54e46799edb12d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e7a9fef10f4aba994347a5d714f17f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:32:12.010798 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-543ae5f1-f70d-41c4-b731-ea2e804feb5e tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] 10.222.0.17 "GET /compute/v2.1/servers/81104a95-fe7a-4983-b5c5-2ad4d2463832" status: 200 len: 1319 microversion: 2.1 time: 0.162716 Aug 06 14:32:12.011481 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 222/428] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:32:11 2022] GET /compute/v2.1/servers/81104a95-fe7a-4983-b5c5-2ad4d2463832 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:32:12.053800 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-a2e63d06-d096-4bad-89a6-6f1c12ff4309 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:32:12.054430 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-a2e63d06-d096-4bad-89a6-6f1c12ff4309 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] [instance: cb14f0c5-5a75-4357-b1d3-78a2174cca02] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:12.060935 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a2e63d06-d096-4bad-89a6-6f1c12ff4309 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:12.061415 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a2e63d06-d096-4bad-89a6-6f1c12ff4309 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:12.061845 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a2e63d06-d096-4bad-89a6-6f1c12ff4309 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:12.062701 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a2e63d06-d096-4bad-89a6-6f1c12ff4309 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:12.063228 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a2e63d06-d096-4bad-89a6-6f1c12ff4309 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:12.063691 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a2e63d06-d096-4bad-89a6-6f1c12ff4309 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:12.194524 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-a2e63d06-d096-4bad-89a6-6f1c12ff4309 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96728f2ae5d4885858560396971a1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a30d14e9a4c0ebd2fd8549a09ee44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:32:12.201906 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-a2e63d06-d096-4bad-89a6-6f1c12ff4309 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] 10.222.0.17 "GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02" status: 200 len: 1359 microversion: 2.1 time: 0.152791 Aug 06 14:32:12.202469 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 207/429] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:32:12 2022] GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:32:12.593806 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-9a555e0d-eef9-4671-9cfc-79a17aa6884e tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:32:12.594408 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-9a555e0d-eef9-4671-9cfc-79a17aa6884e tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: d1cbde5c-7d9e-49cc-ba65-31507c04c60b] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:12.600701 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9a555e0d-eef9-4671-9cfc-79a17aa6884e tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:12.601175 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9a555e0d-eef9-4671-9cfc-79a17aa6884e tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:12.601604 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9a555e0d-eef9-4671-9cfc-79a17aa6884e tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:12.602277 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9a555e0d-eef9-4671-9cfc-79a17aa6884e tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:12.602721 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9a555e0d-eef9-4671-9cfc-79a17aa6884e tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:12.603241 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9a555e0d-eef9-4671-9cfc-79a17aa6884e tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:12.732515 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-9a555e0d-eef9-4671-9cfc-79a17aa6884e tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:32:12.740542 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-9a555e0d-eef9-4671-9cfc-79a17aa6884e tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b" status: 200 len: 1522 microversion: 2.1 time: 0.150828 Aug 06 14:32:12.741097 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 223/430] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:32:12 2022] GET /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:32:13.032625 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-e6774dea-bb22-4034-995a-0b67c8497e38 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:32:13.033150 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-e6774dea-bb22-4034-995a-0b67c8497e38 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] [instance: 81104a95-fe7a-4983-b5c5-2ad4d2463832] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:13.040301 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e6774dea-bb22-4034-995a-0b67c8497e38 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:13.040770 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e6774dea-bb22-4034-995a-0b67c8497e38 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:13.041197 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e6774dea-bb22-4034-995a-0b67c8497e38 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:13.041872 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e6774dea-bb22-4034-995a-0b67c8497e38 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:13.042315 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e6774dea-bb22-4034-995a-0b67c8497e38 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:13.042731 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e6774dea-bb22-4034-995a-0b67c8497e38 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:13.181618 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-e6774dea-bb22-4034-995a-0b67c8497e38 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6f411ed91946eba54e46799edb12d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e7a9fef10f4aba994347a5d714f17f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:32:13.190420 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-e6774dea-bb22-4034-995a-0b67c8497e38 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] 10.222.0.17 "GET /compute/v2.1/servers/81104a95-fe7a-4983-b5c5-2ad4d2463832" status: 200 len: 1506 microversion: 2.1 time: 0.161628 Aug 06 14:32:13.191062 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 208/431] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:32:13 2022] GET /compute/v2.1/servers/81104a95-fe7a-4983-b5c5-2ad4d2463832 => generated 1506 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:32:13.222169 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-713e6f32-6533-43c5-b3fb-9e3f586042cb tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:32:13.222885 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-713e6f32-6533-43c5-b3fb-9e3f586042cb tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] [instance: cb14f0c5-5a75-4357-b1d3-78a2174cca02] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:13.232689 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-713e6f32-6533-43c5-b3fb-9e3f586042cb tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:13.233073 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-713e6f32-6533-43c5-b3fb-9e3f586042cb tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:13.233565 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-713e6f32-6533-43c5-b3fb-9e3f586042cb tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:13.234308 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-713e6f32-6533-43c5-b3fb-9e3f586042cb tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:13.245010 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-713e6f32-6533-43c5-b3fb-9e3f586042cb tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:13.245459 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-713e6f32-6533-43c5-b3fb-9e3f586042cb tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:13.547797 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-713e6f32-6533-43c5-b3fb-9e3f586042cb tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96728f2ae5d4885858560396971a1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a30d14e9a4c0ebd2fd8549a09ee44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:32:13.556208 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-713e6f32-6533-43c5-b3fb-9e3f586042cb tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] 10.222.0.17 "GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02" status: 200 len: 1359 microversion: 2.1 time: 0.337497 Aug 06 14:32:13.570898 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 224/432] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:32:13 2022] GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02 => generated 1359 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:32:13.761283 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-289407eb-5ab3-44a1-9cb0-1f350027fff8 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:32:13.761889 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-289407eb-5ab3-44a1-9cb0-1f350027fff8 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: d1cbde5c-7d9e-49cc-ba65-31507c04c60b] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:13.767827 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-289407eb-5ab3-44a1-9cb0-1f350027fff8 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:13.768308 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-289407eb-5ab3-44a1-9cb0-1f350027fff8 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:13.768739 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-289407eb-5ab3-44a1-9cb0-1f350027fff8 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:13.769421 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-289407eb-5ab3-44a1-9cb0-1f350027fff8 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:13.770003 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-289407eb-5ab3-44a1-9cb0-1f350027fff8 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:13.770441 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-289407eb-5ab3-44a1-9cb0-1f350027fff8 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:13.903869 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-289407eb-5ab3-44a1-9cb0-1f350027fff8 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:32:13.912393 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-289407eb-5ab3-44a1-9cb0-1f350027fff8 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b" status: 200 len: 1522 microversion: 2.1 time: 0.154839 Aug 06 14:32:13.913134 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 209/433] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:32:13 2022] GET /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:32:14.578668 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-c38c0ce2-5b5b-4100-9ec0-e82120c14a52 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:32:14.580118 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-c38c0ce2-5b5b-4100-9ec0-e82120c14a52 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] [instance: cb14f0c5-5a75-4357-b1d3-78a2174cca02] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:14.588003 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c38c0ce2-5b5b-4100-9ec0-e82120c14a52 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:14.588733 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c38c0ce2-5b5b-4100-9ec0-e82120c14a52 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:14.589329 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c38c0ce2-5b5b-4100-9ec0-e82120c14a52 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:14.590247 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c38c0ce2-5b5b-4100-9ec0-e82120c14a52 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:14.590890 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c38c0ce2-5b5b-4100-9ec0-e82120c14a52 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:14.591462 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c38c0ce2-5b5b-4100-9ec0-e82120c14a52 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:14.783084 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-c38c0ce2-5b5b-4100-9ec0-e82120c14a52 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96728f2ae5d4885858560396971a1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a30d14e9a4c0ebd2fd8549a09ee44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:32:14.790789 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-c38c0ce2-5b5b-4100-9ec0-e82120c14a52 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] 10.222.0.17 "GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02" status: 200 len: 1359 microversion: 2.1 time: 0.215773 Aug 06 14:32:14.792108 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 225/434] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:32:14 2022] GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02 => generated 1359 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:32:14.932500 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-8a8c723e-624b-401c-a4e5-9e6ee7a1f06d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:32:14.933102 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-8a8c723e-624b-401c-a4e5-9e6ee7a1f06d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: d1cbde5c-7d9e-49cc-ba65-31507c04c60b] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:14.939963 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8a8c723e-624b-401c-a4e5-9e6ee7a1f06d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:14.940388 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8a8c723e-624b-401c-a4e5-9e6ee7a1f06d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:14.940825 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8a8c723e-624b-401c-a4e5-9e6ee7a1f06d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:14.941769 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8a8c723e-624b-401c-a4e5-9e6ee7a1f06d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:14.942229 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8a8c723e-624b-401c-a4e5-9e6ee7a1f06d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:14.943207 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8a8c723e-624b-401c-a4e5-9e6ee7a1f06d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:15.090601 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-8a8c723e-624b-401c-a4e5-9e6ee7a1f06d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:32:15.098103 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-8a8c723e-624b-401c-a4e5-9e6ee7a1f06d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b" status: 200 len: 1522 microversion: 2.1 time: 0.170089 Aug 06 14:32:15.098658 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 210/435] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:32:14 2022] GET /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:32:15.819135 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-f6ea239a-ea9c-4eb5-b464-a41585fb883a tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:32:15.819135 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-f6ea239a-ea9c-4eb5-b464-a41585fb883a tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] [instance: cb14f0c5-5a75-4357-b1d3-78a2174cca02] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:15.819710 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f6ea239a-ea9c-4eb5-b464-a41585fb883a tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:15.819710 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f6ea239a-ea9c-4eb5-b464-a41585fb883a tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:15.820084 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f6ea239a-ea9c-4eb5-b464-a41585fb883a tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:15.820939 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f6ea239a-ea9c-4eb5-b464-a41585fb883a tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:15.821385 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f6ea239a-ea9c-4eb5-b464-a41585fb883a tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:15.821798 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f6ea239a-ea9c-4eb5-b464-a41585fb883a tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:15.960285 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-f6ea239a-ea9c-4eb5-b464-a41585fb883a tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96728f2ae5d4885858560396971a1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a30d14e9a4c0ebd2fd8549a09ee44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:32:15.968147 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-f6ea239a-ea9c-4eb5-b464-a41585fb883a tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] 10.222.0.17 "GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02" status: 200 len: 1359 microversion: 2.1 time: 0.159846 Aug 06 14:32:15.969031 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 226/436] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:32:15 2022] GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:32:16.118464 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-97e3c408-6c11-48a9-b725-28036bb1c3f6 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:32:16.119320 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-97e3c408-6c11-48a9-b725-28036bb1c3f6 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: d1cbde5c-7d9e-49cc-ba65-31507c04c60b] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:16.125740 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-97e3c408-6c11-48a9-b725-28036bb1c3f6 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:16.126224 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-97e3c408-6c11-48a9-b725-28036bb1c3f6 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:16.126654 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-97e3c408-6c11-48a9-b725-28036bb1c3f6 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:16.127369 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-97e3c408-6c11-48a9-b725-28036bb1c3f6 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:16.127850 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-97e3c408-6c11-48a9-b725-28036bb1c3f6 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:16.128276 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-97e3c408-6c11-48a9-b725-28036bb1c3f6 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:16.264006 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-97e3c408-6c11-48a9-b725-28036bb1c3f6 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:32:16.272928 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-97e3c408-6c11-48a9-b725-28036bb1c3f6 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b" status: 200 len: 1502 microversion: 2.1 time: 0.158348 Aug 06 14:32:16.273925 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 211/437] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:32:16 2022] GET /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b => generated 1502 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:32:16.293111 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-1e9f22af-ae8f-42d5-9b21-128b0ccff0c6 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a84a84fb-33f3-492a-b575-d88b9b6686f0"}} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:32:16.295740 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-1e9f22af-ae8f-42d5-9b21-128b0ccff0c6 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: d1cbde5c-7d9e-49cc-ba65-31507c04c60b] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:16.301693 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1e9f22af-ae8f-42d5-9b21-128b0ccff0c6 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:16.302180 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1e9f22af-ae8f-42d5-9b21-128b0ccff0c6 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:16.302604 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1e9f22af-ae8f-42d5-9b21-128b0ccff0c6 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:16.303334 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1e9f22af-ae8f-42d5-9b21-128b0ccff0c6 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:16.303940 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1e9f22af-ae8f-42d5-9b21-128b0ccff0c6 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:16.304229 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1e9f22af-ae8f-42d5-9b21-128b0ccff0c6 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:16.327388 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_cell1:SELECT=100 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:32:16.335740 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.wsgi [None req-1e9f22af-ae8f-42d5-9b21-128b0ccff0c6 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] HTTP exception thrown: Cannot 'attach_volume' instance d1cbde5c-7d9e-49cc-ba65-31507c04c60b while it is in vm_state rescued Aug 06 14:32:16.337659 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-1e9f22af-ae8f-42d5-9b21-128b0ccff0c6 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Request method failure captured: Aug 06 14:32:16.337659 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: request: POST /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b/os-volume_attachments HTTP/1.1 Aug 06 14:32:16.337659 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Accept: application/json Aug 06 14:32:16.337659 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Accept-Encoding: identity Aug 06 14:32:16.337659 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Connection: close Aug 06 14:32:16.337659 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Content-Length: 74 Aug 06 14:32:16.337659 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Content-Type: application/json Aug 06 14:32:16.337659 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Host: 10.222.0.17 Aug 06 14:32:16.337659 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Openstack-System-Scope: None Aug 06 14:32:16.337659 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: User-Agent: python-urllib3/1.26.11 Aug 06 14:32:16.337659 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Auth-Token: gAAAAABi7nreTiAQh7OGccJzMvpg6S4oeq9E7_giKG29ZsuQVMckwBo811MoZtHu7-VetjuRk3nZzucmu63Ww280erpCJunGj07pbSJnl4FV9pUrtMmgxWxHn25usemMXgtqgjhvbLrZ7mNdr87us3X1_BnoBfsvObjRpmug3z5gc_PZHaYrCyc Aug 06 14:32:16.337659 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Domain-Id: None Aug 06 14:32:16.337659 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Domain-Name: None Aug 06 14:32:16.337659 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Identity-Status: Confirmed Aug 06 14:32:16.337659 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Is-Admin-Project: True Aug 06 14:32:16.337659 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Domain-Id: default Aug 06 14:32:16.337659 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Domain-Name: Default Aug 06 14:32:16.337659 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Id: d19dc46cdcf549b0a6383c8b99d6f15f Aug 06 14:32:16.337659 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-379070379 Aug 06 14:32:16.337659 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Role: member,reader Aug 06 14:32:16.337659 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Roles: member,reader Aug 06 14:32:16.339225 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d19dc46cdcf549b0a6383c8b99d6f15f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d19dc46cdcf549b0a6383c8b99d6f15f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d19dc46cdcf549b0a6383c8b99d6f15f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d19dc46cdcf549b0a6383c8b99d6f15f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 06 14:32:16.339225 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant: tempest-ServerRescueNegativeTestJSON-379070379 Aug 06 14:32:16.339225 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant-Id: d19dc46cdcf549b0a6383c8b99d6f15f Aug 06 14:32:16.339225 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-379070379 Aug 06 14:32:16.339225 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User: tempest-ServerRescueNegativeTestJSON-379070379-project Aug 06 14:32:16.339225 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Domain-Id: default Aug 06 14:32:16.339225 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Domain-Name: Default Aug 06 14:32:16.339225 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Id: 4dadf737392d4153ae50de020534f070 Aug 06 14:32:16.339225 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Name: tempest-ServerRescueNegativeTestJSON-379070379-project Aug 06 14:32:16.339225 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Aug 06 14:32:16.339225 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: {"volumeAttachment": {"volumeId": "a84a84fb-33f3-492a-b575-d88b9b6686f0"}} Aug 06 14:32:16.339225 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: method: > Aug 06 14:32:16.340120 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: exception: Cannot 'attach_volume' instance d1cbde5c-7d9e-49cc-ba65-31507c04c60b while it is in vm_state rescued Aug 06 14:32:16.340120 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: action_args: {'server_id': 'd1cbde5c-7d9e-49cc-ba65-31507c04c60b', 'body': {'volumeAttachment': {'volumeId': 'a84a84fb-33f3-492a-b575-d88b9b6686f0'}}} Aug 06 14:32:16.340120 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 14:32:16.340120 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:32:16.340120 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 06 14:32:16.340120 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 06 14:32:16.340120 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 06 14:32:16.340120 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 06 14:32:16.340120 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 06 14:32:16.340120 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 06 14:32:16.340120 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d1cbde5c-7d9e-49cc-ba65-31507c04c60b in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 06 14:32:16.340120 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:32:16.340120 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:32:16.340120 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:32:16.340120 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:32:16.340120 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:32:16.340120 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:32:16.340120 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 14:32:16.340120 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 14:32:16.341500 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 14:32:16.341500 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 14:32:16.341500 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 14:32:16.341500 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 14:32:16.341500 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 14:32:16.341500 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 14:32:16.341500 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 14:32:16.341500 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 14:32:16.341500 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 06 14:32:16.341500 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 06 14:32:16.341500 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 06 14:32:16.341500 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 06 14:32:16.341500 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance d1cbde5c-7d9e-49cc-ba65-31507c04c60b while it is in vm_state rescued Aug 06 14:32:16.341500 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:32:16.341500 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:32:16.341500 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:32:16.341500 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:32:16.341500 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:32:16.341500 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:32:16.342797 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 14:32:16.342797 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 14:32:16.342797 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance d1cbde5c-7d9e-49cc-ba65-31507c04c60b while it is in vm_state rescued Aug 06 14:32:16.342797 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:32:16.342797 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-1e9f22af-ae8f-42d5-9b21-128b0ccff0c6 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Returning 409 to user: Cannot 'attach_volume' instance d1cbde5c-7d9e-49cc-ba65-31507c04c60b while it is in vm_state rescued {{(pid=117837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 14:32:16.342797 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-1e9f22af-ae8f-42d5-9b21-128b0ccff0c6 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "POST /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.050304 Aug 06 14:32:16.342797 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 227/438] 10.222.0.17 () {60 vars in 1323 bytes} [Sat Aug 6 14:32:16 2022] POST /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b/os-volume_attachments => generated 152 bytes in 52 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 06 14:32:16.348313 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-6840e5f9-ecc7-47d5-a6e3-9e4109eae807 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:32:16.348873 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-6840e5f9-ecc7-47d5-a6e3-9e4109eae807 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: d1cbde5c-7d9e-49cc-ba65-31507c04c60b] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:16.355768 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6840e5f9-ecc7-47d5-a6e3-9e4109eae807 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:16.356434 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6840e5f9-ecc7-47d5-a6e3-9e4109eae807 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:16.356991 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6840e5f9-ecc7-47d5-a6e3-9e4109eae807 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:16.357907 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6840e5f9-ecc7-47d5-a6e3-9e4109eae807 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:16.358523 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6840e5f9-ecc7-47d5-a6e3-9e4109eae807 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:16.359134 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6840e5f9-ecc7-47d5-a6e3-9e4109eae807 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:16.444930 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-6840e5f9-ecc7-47d5-a6e3-9e4109eae807 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "POST /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b/action" status: 202 len: 0 microversion: 2.1 time: 0.100245 Aug 06 14:32:16.446165 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 212/439] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Aug 6 14:32:16 2022] POST /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 06 14:32:16.454210 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-ac733558-db5d-4cd2-bb32-64a920c72b4b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:32:16.454928 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-ac733558-db5d-4cd2-bb32-64a920c72b4b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: d1cbde5c-7d9e-49cc-ba65-31507c04c60b] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:16.461794 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ac733558-db5d-4cd2-bb32-64a920c72b4b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:16.462550 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ac733558-db5d-4cd2-bb32-64a920c72b4b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:16.463088 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ac733558-db5d-4cd2-bb32-64a920c72b4b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:16.463980 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ac733558-db5d-4cd2-bb32-64a920c72b4b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:16.464726 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ac733558-db5d-4cd2-bb32-64a920c72b4b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:16.465220 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ac733558-db5d-4cd2-bb32-64a920c72b4b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:16.607890 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-ac733558-db5d-4cd2-bb32-64a920c72b4b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:32:16.616704 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-ac733558-db5d-4cd2-bb32-64a920c72b4b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b" status: 200 len: 1510 microversion: 2.1 time: 0.166548 Aug 06 14:32:16.617401 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 228/440] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:32:16 2022] GET /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b => generated 1510 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:32:16.989441 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-613f81be-bc77-4fd5-b374-ade6e46d1cd6 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:32:16.990172 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-613f81be-bc77-4fd5-b374-ade6e46d1cd6 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] [instance: cb14f0c5-5a75-4357-b1d3-78a2174cca02] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:16.997756 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-613f81be-bc77-4fd5-b374-ade6e46d1cd6 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:16.998355 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-613f81be-bc77-4fd5-b374-ade6e46d1cd6 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:16.999040 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-613f81be-bc77-4fd5-b374-ade6e46d1cd6 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:16.999978 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-613f81be-bc77-4fd5-b374-ade6e46d1cd6 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:17.000516 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-613f81be-bc77-4fd5-b374-ade6e46d1cd6 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:17.001009 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-613f81be-bc77-4fd5-b374-ade6e46d1cd6 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:17.150075 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-613f81be-bc77-4fd5-b374-ade6e46d1cd6 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96728f2ae5d4885858560396971a1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a30d14e9a4c0ebd2fd8549a09ee44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:32:17.157758 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-613f81be-bc77-4fd5-b374-ade6e46d1cd6 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] 10.222.0.17 "GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02" status: 200 len: 1359 microversion: 2.1 time: 0.172881 Aug 06 14:32:17.158318 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 213/441] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:32:16 2022] GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02 => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:32:17.640927 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-ca2b151d-ef20-4448-9608-ef9efc199d5d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:32:17.641539 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-ca2b151d-ef20-4448-9608-ef9efc199d5d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: d1cbde5c-7d9e-49cc-ba65-31507c04c60b] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:17.647535 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ca2b151d-ef20-4448-9608-ef9efc199d5d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:17.648010 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ca2b151d-ef20-4448-9608-ef9efc199d5d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:17.648435 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ca2b151d-ef20-4448-9608-ef9efc199d5d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:17.649116 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ca2b151d-ef20-4448-9608-ef9efc199d5d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:17.649561 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ca2b151d-ef20-4448-9608-ef9efc199d5d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:17.649976 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ca2b151d-ef20-4448-9608-ef9efc199d5d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:17.853192 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-ca2b151d-ef20-4448-9608-ef9efc199d5d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:32:17.861148 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-ca2b151d-ef20-4448-9608-ef9efc199d5d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b" status: 200 len: 1510 microversion: 2.1 time: 0.224131 Aug 06 14:32:17.861752 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 229/442] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:32:17 2022] GET /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b => generated 1510 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:32:18.177520 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-9231afd2-ad4a-434e-ae71-60c62660151f tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:32:18.178125 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-9231afd2-ad4a-434e-ae71-60c62660151f tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] [instance: cb14f0c5-5a75-4357-b1d3-78a2174cca02] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:18.184333 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9231afd2-ad4a-434e-ae71-60c62660151f tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:18.184806 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9231afd2-ad4a-434e-ae71-60c62660151f tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:18.185232 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9231afd2-ad4a-434e-ae71-60c62660151f tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:18.185911 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9231afd2-ad4a-434e-ae71-60c62660151f tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:18.186358 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9231afd2-ad4a-434e-ae71-60c62660151f tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:18.186887 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9231afd2-ad4a-434e-ae71-60c62660151f tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:18.326576 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-9231afd2-ad4a-434e-ae71-60c62660151f tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96728f2ae5d4885858560396971a1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a30d14e9a4c0ebd2fd8549a09ee44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:32:18.334421 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-9231afd2-ad4a-434e-ae71-60c62660151f tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] 10.222.0.17 "GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02" status: 200 len: 1359 microversion: 2.1 time: 0.160633 Aug 06 14:32:18.335001 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 214/443] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:32:18 2022] GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:32:18.883572 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-c3943d66-b639-4e17-a2f2-9ab89860afb5 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:32:18.884472 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-c3943d66-b639-4e17-a2f2-9ab89860afb5 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: d1cbde5c-7d9e-49cc-ba65-31507c04c60b] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:18.890329 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c3943d66-b639-4e17-a2f2-9ab89860afb5 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:18.890809 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c3943d66-b639-4e17-a2f2-9ab89860afb5 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:18.891457 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c3943d66-b639-4e17-a2f2-9ab89860afb5 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:18.892143 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c3943d66-b639-4e17-a2f2-9ab89860afb5 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:18.892595 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c3943d66-b639-4e17-a2f2-9ab89860afb5 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:18.893016 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c3943d66-b639-4e17-a2f2-9ab89860afb5 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:19.034159 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-c3943d66-b639-4e17-a2f2-9ab89860afb5 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:32:19.041830 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-c3943d66-b639-4e17-a2f2-9ab89860afb5 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b" status: 200 len: 1510 microversion: 2.1 time: 0.162661 Aug 06 14:32:19.042392 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 230/444] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:32:18 2022] GET /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b => generated 1510 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:32:19.355780 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-7cd0c127-c3cc-4230-a4f4-bb2502bf9c87 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:32:19.357014 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-7cd0c127-c3cc-4230-a4f4-bb2502bf9c87 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] [instance: cb14f0c5-5a75-4357-b1d3-78a2174cca02] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:19.363294 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7cd0c127-c3cc-4230-a4f4-bb2502bf9c87 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:19.363780 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7cd0c127-c3cc-4230-a4f4-bb2502bf9c87 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:19.364873 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7cd0c127-c3cc-4230-a4f4-bb2502bf9c87 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:19.365565 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7cd0c127-c3cc-4230-a4f4-bb2502bf9c87 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:19.366257 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7cd0c127-c3cc-4230-a4f4-bb2502bf9c87 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:19.366687 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7cd0c127-c3cc-4230-a4f4-bb2502bf9c87 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:19.527830 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-7cd0c127-c3cc-4230-a4f4-bb2502bf9c87 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96728f2ae5d4885858560396971a1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a30d14e9a4c0ebd2fd8549a09ee44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:32:19.535531 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-7cd0c127-c3cc-4230-a4f4-bb2502bf9c87 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] 10.222.0.17 "GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02" status: 200 len: 1359 microversion: 2.1 time: 0.183793 Aug 06 14:32:19.536737 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 215/445] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:32:19 2022] GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02 => generated 1359 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:32:20.063751 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-d2920a5f-d77d-4f99-ad5f-260e94d929c8 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:32:20.064395 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-d2920a5f-d77d-4f99-ad5f-260e94d929c8 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: d1cbde5c-7d9e-49cc-ba65-31507c04c60b] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:20.070983 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d2920a5f-d77d-4f99-ad5f-260e94d929c8 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:20.071470 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d2920a5f-d77d-4f99-ad5f-260e94d929c8 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:20.071909 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d2920a5f-d77d-4f99-ad5f-260e94d929c8 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:20.072612 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d2920a5f-d77d-4f99-ad5f-260e94d929c8 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:20.073069 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d2920a5f-d77d-4f99-ad5f-260e94d929c8 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:20.073495 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d2920a5f-d77d-4f99-ad5f-260e94d929c8 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:20.234468 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-d2920a5f-d77d-4f99-ad5f-260e94d929c8 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:32:20.242134 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-d2920a5f-d77d-4f99-ad5f-260e94d929c8 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b" status: 200 len: 1510 microversion: 2.1 time: 0.182369 Aug 06 14:32:20.242694 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 231/446] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:32:20 2022] GET /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b => generated 1510 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:32:20.557691 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-69c0e4c7-553d-42f3-95f3-ef7c888f92a8 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:32:20.558339 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-69c0e4c7-553d-42f3-95f3-ef7c888f92a8 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] [instance: cb14f0c5-5a75-4357-b1d3-78a2174cca02] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:20.564616 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-69c0e4c7-553d-42f3-95f3-ef7c888f92a8 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:20.565099 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-69c0e4c7-553d-42f3-95f3-ef7c888f92a8 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:20.565534 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-69c0e4c7-553d-42f3-95f3-ef7c888f92a8 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:20.566226 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-69c0e4c7-553d-42f3-95f3-ef7c888f92a8 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:20.566677 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-69c0e4c7-553d-42f3-95f3-ef7c888f92a8 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:20.567179 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-69c0e4c7-553d-42f3-95f3-ef7c888f92a8 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:20.703387 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-69c0e4c7-553d-42f3-95f3-ef7c888f92a8 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96728f2ae5d4885858560396971a1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a30d14e9a4c0ebd2fd8549a09ee44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:32:20.710753 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-69c0e4c7-553d-42f3-95f3-ef7c888f92a8 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] 10.222.0.17 "GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02" status: 200 len: 1359 microversion: 2.1 time: 0.157508 Aug 06 14:32:20.711371 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 216/447] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:32:20 2022] GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:32:21.262495 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-6ddc601d-8fe9-4535-80fc-3503f7884d21 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:32:21.263126 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-6ddc601d-8fe9-4535-80fc-3503f7884d21 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: d1cbde5c-7d9e-49cc-ba65-31507c04c60b] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:21.271612 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6ddc601d-8fe9-4535-80fc-3503f7884d21 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:21.272092 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6ddc601d-8fe9-4535-80fc-3503f7884d21 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:21.272551 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6ddc601d-8fe9-4535-80fc-3503f7884d21 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:21.273235 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6ddc601d-8fe9-4535-80fc-3503f7884d21 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:21.273718 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6ddc601d-8fe9-4535-80fc-3503f7884d21 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:21.274134 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6ddc601d-8fe9-4535-80fc-3503f7884d21 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:21.406332 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-6ddc601d-8fe9-4535-80fc-3503f7884d21 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:32:21.413837 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-6ddc601d-8fe9-4535-80fc-3503f7884d21 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b" status: 200 len: 1510 microversion: 2.1 time: 0.155213 Aug 06 14:32:21.414422 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 232/448] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:32:21 2022] GET /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:32:21.732625 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-0cb6d45e-168c-4597-bf65-06e2acfba723 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:32:21.733265 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-0cb6d45e-168c-4597-bf65-06e2acfba723 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] [instance: cb14f0c5-5a75-4357-b1d3-78a2174cca02] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:21.739710 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0cb6d45e-168c-4597-bf65-06e2acfba723 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:21.740197 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0cb6d45e-168c-4597-bf65-06e2acfba723 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:21.740632 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0cb6d45e-168c-4597-bf65-06e2acfba723 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:21.741326 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0cb6d45e-168c-4597-bf65-06e2acfba723 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:21.741774 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0cb6d45e-168c-4597-bf65-06e2acfba723 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:21.742189 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0cb6d45e-168c-4597-bf65-06e2acfba723 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:21.873186 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-0cb6d45e-168c-4597-bf65-06e2acfba723 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96728f2ae5d4885858560396971a1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a30d14e9a4c0ebd2fd8549a09ee44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:32:21.881338 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-0cb6d45e-168c-4597-bf65-06e2acfba723 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] 10.222.0.17 "GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02" status: 200 len: 1359 microversion: 2.1 time: 0.152570 Aug 06 14:32:21.881898 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 217/449] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:32:21 2022] GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:32:22.435514 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-5708e844-769c-4715-868a-7ac808b116ba tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:32:22.436116 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-5708e844-769c-4715-868a-7ac808b116ba tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: d1cbde5c-7d9e-49cc-ba65-31507c04c60b] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:22.441971 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-5708e844-769c-4715-868a-7ac808b116ba tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:22.442976 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-5708e844-769c-4715-868a-7ac808b116ba tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:22.443410 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-5708e844-769c-4715-868a-7ac808b116ba tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:22.444088 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-5708e844-769c-4715-868a-7ac808b116ba tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:22.444541 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-5708e844-769c-4715-868a-7ac808b116ba tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:22.444970 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-5708e844-769c-4715-868a-7ac808b116ba tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:22.580761 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-5708e844-769c-4715-868a-7ac808b116ba tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:32:22.588529 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-5708e844-769c-4715-868a-7ac808b116ba tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b" status: 200 len: 1510 microversion: 2.1 time: 0.156890 Aug 06 14:32:22.589101 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 233/450] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:32:22 2022] GET /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b => generated 1510 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:32:22.772450 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [req-1525e67c-701c-48a8-8f9a-21d80739b8c0 req-fad5668f-4811-4801-bc40-de0e587202f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb14f0c5-5a75-4357-b1d3-78a2174cca02", "name": "network-vif-plugged", "status": "completed", "tag": "0bc19d76-ece6-4342-a828-3e88712b2b00"}]} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:32:22.790145 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-1525e67c-701c-48a8-8f9a-21d80739b8c0 req-fad5668f-4811-4801-bc40-de0e587202f9 service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:22.790822 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-1525e67c-701c-48a8-8f9a-21d80739b8c0 req-fad5668f-4811-4801-bc40-de0e587202f9 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:22.791269 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-1525e67c-701c-48a8-8f9a-21d80739b8c0 req-fad5668f-4811-4801-bc40-de0e587202f9 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:22.806689 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.compute.server_external_events [req-1525e67c-701c-48a8-8f9a-21d80739b8c0 req-fad5668f-4811-4801-bc40-de0e587202f9 service nova] Creating event network-vif-plugged:0bc19d76-ece6-4342-a828-3e88712b2b00 for instance cb14f0c5-5a75-4357-b1d3-78a2174cca02 on hv-cinder-85199 Aug 06 14:32:22.814453 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [req-1525e67c-701c-48a8-8f9a-21d80739b8c0 req-fad5668f-4811-4801-bc40-de0e587202f9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045169 Aug 06 14:32:22.814776 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 218/451] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:32:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:32:22.901363 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-f655f2b3-3c66-4412-84f3-21a4b8bdaec6 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:32:22.901973 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-f655f2b3-3c66-4412-84f3-21a4b8bdaec6 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] [instance: cb14f0c5-5a75-4357-b1d3-78a2174cca02] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:22.908031 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f655f2b3-3c66-4412-84f3-21a4b8bdaec6 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:22.908506 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f655f2b3-3c66-4412-84f3-21a4b8bdaec6 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:22.908934 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f655f2b3-3c66-4412-84f3-21a4b8bdaec6 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:22.909609 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f655f2b3-3c66-4412-84f3-21a4b8bdaec6 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:22.910063 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f655f2b3-3c66-4412-84f3-21a4b8bdaec6 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:22.910482 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f655f2b3-3c66-4412-84f3-21a4b8bdaec6 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:23.040023 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-f655f2b3-3c66-4412-84f3-21a4b8bdaec6 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96728f2ae5d4885858560396971a1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a30d14e9a4c0ebd2fd8549a09ee44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:32:23.047416 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-f655f2b3-3c66-4412-84f3-21a4b8bdaec6 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] 10.222.0.17 "GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02" status: 200 len: 1359 microversion: 2.1 time: 0.149874 Aug 06 14:32:23.047978 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 234/452] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:32:22 2022] GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02 => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:32:23.609910 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-f3440016-c4ad-4019-89c5-0435d72f373e tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:32:23.610517 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-f3440016-c4ad-4019-89c5-0435d72f373e tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: d1cbde5c-7d9e-49cc-ba65-31507c04c60b] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:23.612509 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:32:23.618214 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f3440016-c4ad-4019-89c5-0435d72f373e tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:23.618692 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f3440016-c4ad-4019-89c5-0435d72f373e tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:23.619161 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f3440016-c4ad-4019-89c5-0435d72f373e tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:23.619847 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f3440016-c4ad-4019-89c5-0435d72f373e tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:23.620301 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f3440016-c4ad-4019-89c5-0435d72f373e tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:23.620749 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f3440016-c4ad-4019-89c5-0435d72f373e tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:23.762582 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-f3440016-c4ad-4019-89c5-0435d72f373e tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:32:23.771321 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-f3440016-c4ad-4019-89c5-0435d72f373e tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b" status: 200 len: 1510 microversion: 2.1 time: 0.165882 Aug 06 14:32:23.771885 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 219/453] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:32:23 2022] GET /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b => generated 1510 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:32:24.069484 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-48d75c29-794c-4012-a7bd-8e1931dcb091 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:32:24.070133 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-48d75c29-794c-4012-a7bd-8e1931dcb091 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] [instance: cb14f0c5-5a75-4357-b1d3-78a2174cca02] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:24.076021 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-48d75c29-794c-4012-a7bd-8e1931dcb091 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:24.076505 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-48d75c29-794c-4012-a7bd-8e1931dcb091 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:24.076937 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-48d75c29-794c-4012-a7bd-8e1931dcb091 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:24.077632 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-48d75c29-794c-4012-a7bd-8e1931dcb091 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:24.078087 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-48d75c29-794c-4012-a7bd-8e1931dcb091 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:24.078511 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-48d75c29-794c-4012-a7bd-8e1931dcb091 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:24.213839 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-48d75c29-794c-4012-a7bd-8e1931dcb091 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96728f2ae5d4885858560396971a1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a30d14e9a4c0ebd2fd8549a09ee44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:32:24.221425 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-48d75c29-794c-4012-a7bd-8e1931dcb091 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] 10.222.0.17 "GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02" status: 200 len: 1359 microversion: 2.1 time: 0.156649 Aug 06 14:32:24.221997 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 235/454] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:32:24 2022] GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:32:24.793178 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-b6700e00-d833-442d-a9d6-16742cbb3fd7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:32:24.793759 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-b6700e00-d833-442d-a9d6-16742cbb3fd7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: d1cbde5c-7d9e-49cc-ba65-31507c04c60b] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:24.800651 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b6700e00-d833-442d-a9d6-16742cbb3fd7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:24.801138 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b6700e00-d833-442d-a9d6-16742cbb3fd7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:24.801570 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b6700e00-d833-442d-a9d6-16742cbb3fd7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:24.802270 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b6700e00-d833-442d-a9d6-16742cbb3fd7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:24.802721 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b6700e00-d833-442d-a9d6-16742cbb3fd7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:24.803223 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b6700e00-d833-442d-a9d6-16742cbb3fd7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:24.818399 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:32:24.937056 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-b6700e00-d833-442d-a9d6-16742cbb3fd7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:32:24.944541 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-b6700e00-d833-442d-a9d6-16742cbb3fd7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b" status: 200 len: 1516 microversion: 2.1 time: 0.155425 Aug 06 14:32:24.945107 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 220/455] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:32:24 2022] GET /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:32:25.242295 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-0bc3f284-41ed-4c08-a7d4-b1acfe2ac6a4 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:32:25.242941 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-0bc3f284-41ed-4c08-a7d4-b1acfe2ac6a4 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] [instance: cb14f0c5-5a75-4357-b1d3-78a2174cca02] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:25.250295 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0bc3f284-41ed-4c08-a7d4-b1acfe2ac6a4 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:25.250792 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0bc3f284-41ed-4c08-a7d4-b1acfe2ac6a4 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:25.251252 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0bc3f284-41ed-4c08-a7d4-b1acfe2ac6a4 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:25.251950 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0bc3f284-41ed-4c08-a7d4-b1acfe2ac6a4 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:25.252401 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0bc3f284-41ed-4c08-a7d4-b1acfe2ac6a4 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:25.252825 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0bc3f284-41ed-4c08-a7d4-b1acfe2ac6a4 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:25.390626 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-0bc3f284-41ed-4c08-a7d4-b1acfe2ac6a4 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96728f2ae5d4885858560396971a1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a30d14e9a4c0ebd2fd8549a09ee44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:32:25.398708 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-0bc3f284-41ed-4c08-a7d4-b1acfe2ac6a4 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] 10.222.0.17 "GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02" status: 200 len: 1359 microversion: 2.1 time: 0.161016 Aug 06 14:32:25.399295 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 236/456] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:32:25 2022] GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:32:26.419342 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-4176236b-66a0-4265-a682-adff47888ca1 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:32:26.419938 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-4176236b-66a0-4265-a682-adff47888ca1 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] [instance: cb14f0c5-5a75-4357-b1d3-78a2174cca02] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:26.426317 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4176236b-66a0-4265-a682-adff47888ca1 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:26.426793 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4176236b-66a0-4265-a682-adff47888ca1 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:26.427251 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4176236b-66a0-4265-a682-adff47888ca1 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:26.427930 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4176236b-66a0-4265-a682-adff47888ca1 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:26.428377 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4176236b-66a0-4265-a682-adff47888ca1 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:26.428798 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4176236b-66a0-4265-a682-adff47888ca1 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:26.562684 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-4176236b-66a0-4265-a682-adff47888ca1 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96728f2ae5d4885858560396971a1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a30d14e9a4c0ebd2fd8549a09ee44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:32:26.570632 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-4176236b-66a0-4265-a682-adff47888ca1 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] 10.222.0.17 "GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02" status: 200 len: 1359 microversion: 2.1 time: 0.155054 Aug 06 14:32:26.571233 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 221/457] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:32:26 2022] GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:32:27.355228 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-b64dcbbf-0380-4311-a534-3e40a8391e9b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Action: 'create', calling method: .version_select at 0x7fbab187b940>, body: {"keypair": {"name": "tempest-keypair-660528770", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE9MtLlwr2aBjtGePjNmpeEdeyBkqPLc8dA4UV940HR0GMhp8ffHQc/5+HgGiqBkbSVQpQIrS3sfTrREvKItl1ETnx7GAYyNziqCbiMBn4r0BdAlis10y4dkQmJzj1VvtA=="}} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:32:27.370362 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.quota [None req-b64dcbbf-0380-4311-a534-3e40a8391e9b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Getting quotas for project d19dc46cdcf549b0a6383c8b99d6f15f. Resources: {'key_pairs'} {{(pid=117837) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 14:32:27.374541 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.quota [None req-b64dcbbf-0380-4311-a534-3e40a8391e9b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Getting quotas for user 4dadf737392d4153ae50de020534f070 and project d19dc46cdcf549b0a6383c8b99d6f15f. Resources: {'key_pairs'} {{(pid=117837) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 14:32:27.399419 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-b64dcbbf-0380-4311-a534-3e40a8391e9b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047940 Aug 06 14:32:27.400015 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 237/458] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Aug 6 14:32:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:32:27.591418 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-6e23f0a9-f09f-4e16-81ea-c1f89322c4da tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:32:27.592214 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-6e23f0a9-f09f-4e16-81ea-c1f89322c4da tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] [instance: cb14f0c5-5a75-4357-b1d3-78a2174cca02] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:27.598640 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6e23f0a9-f09f-4e16-81ea-c1f89322c4da tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:27.599226 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6e23f0a9-f09f-4e16-81ea-c1f89322c4da tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:27.599735 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6e23f0a9-f09f-4e16-81ea-c1f89322c4da tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:27.600496 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6e23f0a9-f09f-4e16-81ea-c1f89322c4da tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:27.601018 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6e23f0a9-f09f-4e16-81ea-c1f89322c4da tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:27.601513 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6e23f0a9-f09f-4e16-81ea-c1f89322c4da tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:27.768743 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-6e23f0a9-f09f-4e16-81ea-c1f89322c4da tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96728f2ae5d4885858560396971a1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a30d14e9a4c0ebd2fd8549a09ee44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:32:27.776394 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-6e23f0a9-f09f-4e16-81ea-c1f89322c4da tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] 10.222.0.17 "GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02" status: 200 len: 1549 microversion: 2.1 time: 0.188819 Aug 06 14:32:27.776953 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 222/459] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:32:27 2022] GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02 => generated 1549 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:32:27.797126 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-e507106b-1d46-4167-899c-5b731c21e7eb tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:32:27.798585 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-e507106b-1d46-4167-899c-5b731c21e7eb tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] [instance: cb14f0c5-5a75-4357-b1d3-78a2174cca02] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:27.805515 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e507106b-1d46-4167-899c-5b731c21e7eb tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:27.806331 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e507106b-1d46-4167-899c-5b731c21e7eb tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:27.806828 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e507106b-1d46-4167-899c-5b731c21e7eb tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:27.807626 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e507106b-1d46-4167-899c-5b731c21e7eb tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:27.808142 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e507106b-1d46-4167-899c-5b731c21e7eb tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:27.808628 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e507106b-1d46-4167-899c-5b731c21e7eb tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:27.948980 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-e507106b-1d46-4167-899c-5b731c21e7eb tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96728f2ae5d4885858560396971a1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a30d14e9a4c0ebd2fd8549a09ee44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:32:27.957426 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-e507106b-1d46-4167-899c-5b731c21e7eb tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] 10.222.0.17 "GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02" status: 200 len: 1549 microversion: 2.1 time: 0.163981 Aug 06 14:32:27.958747 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 238/460] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:32:27 2022] GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02 => generated 1549 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:32:27.980209 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-e96bb6ab-9ace-4a0d-85b8-4b9542e8001c tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:32:27.984997 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-e96bb6ab-9ace-4a0d-85b8-4b9542e8001c tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f96728f2ae5d4885858560396971a1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a30d14e9a4c0ebd2fd8549a09ee44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:32:27.985749 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-e96bb6ab-9ace-4a0d-85b8-4b9542e8001c tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Searching by: {'deleted': False, 'project_id': 'ca1a30d14e9a4c0ebd2fd8549a09ee44'} {{(pid=117838) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 06 14:32:27.993443 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e96bb6ab-9ace-4a0d-85b8-4b9542e8001c tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:27.993923 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e96bb6ab-9ace-4a0d-85b8-4b9542e8001c tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:27.994353 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e96bb6ab-9ace-4a0d-85b8-4b9542e8001c tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:27.995096 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e96bb6ab-9ace-4a0d-85b8-4b9542e8001c tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:27.995542 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e96bb6ab-9ace-4a0d-85b8-4b9542e8001c tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:27.995959 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e96bb6ab-9ace-4a0d-85b8-4b9542e8001c tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:28.088118 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.multi_cell_list [None req-e96bb6ab-9ace-4a0d-85b8-4b9542e8001c tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117838) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 06 14:32:28.183417 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-e96bb6ab-9ace-4a0d-85b8-4b9542e8001c tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.209428 Aug 06 14:32:28.184008 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 223/461] 10.222.0.17 () {58 vars in 1125 bytes} [Sat Aug 6 14:32:27 2022] GET /compute/v2.1/servers => generated 343 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:32:28.195837 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-040c6d28-928b-4e1d-9776-f0efcefa8765 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:32:28.196444 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-040c6d28-928b-4e1d-9776-f0efcefa8765 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] [instance: cb14f0c5-5a75-4357-b1d3-78a2174cca02] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:28.202647 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-040c6d28-928b-4e1d-9776-f0efcefa8765 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:28.203209 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-040c6d28-928b-4e1d-9776-f0efcefa8765 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:28.203641 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-040c6d28-928b-4e1d-9776-f0efcefa8765 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:28.204595 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-040c6d28-928b-4e1d-9776-f0efcefa8765 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:28.205044 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-040c6d28-928b-4e1d-9776-f0efcefa8765 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:28.205468 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-040c6d28-928b-4e1d-9776-f0efcefa8765 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:28.347773 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-040c6d28-928b-4e1d-9776-f0efcefa8765 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96728f2ae5d4885858560396971a1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a30d14e9a4c0ebd2fd8549a09ee44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:32:28.356547 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-040c6d28-928b-4e1d-9776-f0efcefa8765 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] 10.222.0.17 "GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02" status: 200 len: 1549 microversion: 2.1 time: 0.164865 Aug 06 14:32:28.357891 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 239/462] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:32:28 2022] GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02 => generated 1549 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:32:29.059586 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-812c6ab9-5eea-4c81-8d0c-331c82f42c29 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-602957051", "imageRef": "13d7ee60-c9c3-43ee-9861-a9192a114a77", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d218904d-31f8-43c0-928a-70585b79ffc2"}], "security_groups": [{"name": "tempest-securitygroup--2072592722"}], "key_name": "tempest-keypair-660528770", "user_data": "}} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:32:29.162602 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.network.neutron [None req-812c6ab9-5eea-4c81-8d0c-331c82f42c29 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] validate_networks() for [('d218904d-31f8-43c0-928a-70585b79ffc2', None, None, None, None, None)] {{(pid=117838) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 14:32:29.549992 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.virt.hardware [None req-812c6ab9-5eea-4c81-8d0c-331c82f42c29 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Flavor limits 0:0:0 {{(pid=117838) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 14:32:29.550412 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.virt.hardware [None req-812c6ab9-5eea-4c81-8d0c-331c82f42c29 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Image limits 0:0:0 {{(pid=117838) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 14:32:29.550916 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.virt.hardware [None req-812c6ab9-5eea-4c81-8d0c-331c82f42c29 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Flavor pref 0:0:0 {{(pid=117838) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 14:32:29.551598 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.virt.hardware [None req-812c6ab9-5eea-4c81-8d0c-331c82f42c29 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Image pref 0:0:0 {{(pid=117838) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 14:32:29.551748 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.virt.hardware [None req-812c6ab9-5eea-4c81-8d0c-331c82f42c29 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117838) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 14:32:29.562310 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-812c6ab9-5eea-4c81-8d0c-331c82f42c29 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:29.562778 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-812c6ab9-5eea-4c81-8d0c-331c82f42c29 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:29.563245 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-812c6ab9-5eea-4c81-8d0c-331c82f42c29 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:29.563962 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-812c6ab9-5eea-4c81-8d0c-331c82f42c29 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:29.564407 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-812c6ab9-5eea-4c81-8d0c-331c82f42c29 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:29.564821 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-812c6ab9-5eea-4c81-8d0c-331c82f42c29 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:29.581186 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.quota [None req-812c6ab9-5eea-4c81-8d0c-331c82f42c29 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Getting quotas for project d19dc46cdcf549b0a6383c8b99d6f15f. Resources: {'cores', 'instances', 'ram'} {{(pid=117838) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 14:32:29.585509 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.quota [None req-812c6ab9-5eea-4c81-8d0c-331c82f42c29 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Getting quotas for user 4dadf737392d4153ae50de020534f070 and project d19dc46cdcf549b0a6383c8b99d6f15f. Resources: {'cores', 'instances', 'ram'} {{(pid=117838) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 14:32:29.596456 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-812c6ab9-5eea-4c81-8d0c-331c82f42c29 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Going to run 1 instances... {{(pid=117838) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 14:32:29.598648 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-812c6ab9-5eea-4c81-8d0c-331c82f42c29 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 8805d1fa-6d65-45c7-ae75-17e46feccccb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='13d7ee60-c9c3-43ee-9861-a9192a114a77',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117838) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 14:32:29.647835 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-812c6ab9-5eea-4c81-8d0c-331c82f42c29 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.592742 Aug 06 14:32:29.648474 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 224/463] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Aug 6 14:32:29 2022] POST /compute/v2.1/servers => generated 409 bytes in 594 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 14:32:29.659243 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-8de56a4f-313c-451a-bbab-9df8b2fe9282 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:32:29.659842 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-8de56a4f-313c-451a-bbab-9df8b2fe9282 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 8805d1fa-6d65-45c7-ae75-17e46feccccb] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:29.735746 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-8de56a4f-313c-451a-bbab-9df8b2fe9282 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:32:29.744257 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-8de56a4f-313c-451a-bbab-9df8b2fe9282 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb" status: 200 len: 1244 microversion: 2.1 time: 0.088879 Aug 06 14:32:29.757200 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 240/464] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:32:29 2022] GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb => generated 1244 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:32:30.770367 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-1dd6a6bd-080c-4e7b-9883-8d71df8f059b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:32:30.771012 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-1dd6a6bd-080c-4e7b-9883-8d71df8f059b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 8805d1fa-6d65-45c7-ae75-17e46feccccb] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:30.778462 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1dd6a6bd-080c-4e7b-9883-8d71df8f059b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:30.778976 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1dd6a6bd-080c-4e7b-9883-8d71df8f059b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:30.779410 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1dd6a6bd-080c-4e7b-9883-8d71df8f059b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:30.780092 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1dd6a6bd-080c-4e7b-9883-8d71df8f059b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:30.780541 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1dd6a6bd-080c-4e7b-9883-8d71df8f059b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:30.780960 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1dd6a6bd-080c-4e7b-9883-8d71df8f059b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:30.911433 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-1dd6a6bd-080c-4e7b-9883-8d71df8f059b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:32:30.920163 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-1dd6a6bd-080c-4e7b-9883-8d71df8f059b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb" status: 200 len: 1304 microversion: 2.1 time: 0.158510 Aug 06 14:32:30.934664 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 225/465] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:32:30 2022] GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb => generated 1304 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:32:31.031868 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-e6d826a6-afde-40c9-85bc-7f466e9d160f tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7e1594bd-5f84-4455-bbe3-a9957550a4e8"}} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:32:31.034569 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-e6d826a6-afde-40c9-85bc-7f466e9d160f tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] [instance: cb14f0c5-5a75-4357-b1d3-78a2174cca02] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:31.040427 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e6d826a6-afde-40c9-85bc-7f466e9d160f tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:31.040905 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e6d826a6-afde-40c9-85bc-7f466e9d160f tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:31.041339 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e6d826a6-afde-40c9-85bc-7f466e9d160f tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:31.042008 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e6d826a6-afde-40c9-85bc-7f466e9d160f tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:31.042459 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e6d826a6-afde-40c9-85bc-7f466e9d160f tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:31.042895 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e6d826a6-afde-40c9-85bc-7f466e9d160f tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:31.372762 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-e6d826a6-afde-40c9-85bc-7f466e9d160f tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] 10.222.0.17 "POST /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.344521 Aug 06 14:32:31.379149 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 241/466] 10.222.0.17 () {60 vars in 1323 bytes} [Sat Aug 6 14:32:31 2022] POST /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02/os-volume_attachments => generated 194 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:32:31.941109 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-76c31164-6e05-46dc-b5fc-ba48b90dd348 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:32:31.942420 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-76c31164-6e05-46dc-b5fc-ba48b90dd348 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 8805d1fa-6d65-45c7-ae75-17e46feccccb] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:31.950643 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-76c31164-6e05-46dc-b5fc-ba48b90dd348 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:31.951317 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-76c31164-6e05-46dc-b5fc-ba48b90dd348 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:31.951915 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-76c31164-6e05-46dc-b5fc-ba48b90dd348 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:31.952744 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-76c31164-6e05-46dc-b5fc-ba48b90dd348 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:31.953261 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-76c31164-6e05-46dc-b5fc-ba48b90dd348 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:31.953741 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-76c31164-6e05-46dc-b5fc-ba48b90dd348 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:32.170117 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-76c31164-6e05-46dc-b5fc-ba48b90dd348 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:32:32.177545 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-76c31164-6e05-46dc-b5fc-ba48b90dd348 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb" status: 200 len: 1370 microversion: 2.1 time: 0.240272 Aug 06 14:32:32.178106 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 226/467] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:32:31 2022] GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb => generated 1370 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:32:32.468612 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [req-e4271dfe-8985-45af-9b7e-ca589d5c75a4 req-d9b54891-a676-46ed-8f36-038b0785a3ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8805d1fa-6d65-45c7-ae75-17e46feccccb", "tag": "6b7de55b-a834-4f94-92da-b46aaa6033a5"}]} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:32:32.479213 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-e4271dfe-8985-45af-9b7e-ca589d5c75a4 req-d9b54891-a676-46ed-8f36-038b0785a3ba service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:32.479684 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-e4271dfe-8985-45af-9b7e-ca589d5c75a4 req-d9b54891-a676-46ed-8f36-038b0785a3ba service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:32.480865 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-e4271dfe-8985-45af-9b7e-ca589d5c75a4 req-d9b54891-a676-46ed-8f36-038b0785a3ba service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:32.492662 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.compute.server_external_events [req-e4271dfe-8985-45af-9b7e-ca589d5c75a4 req-d9b54891-a676-46ed-8f36-038b0785a3ba service nova] Creating event network-changed:6b7de55b-a834-4f94-92da-b46aaa6033a5 for instance 8805d1fa-6d65-45c7-ae75-17e46feccccb on hv-cinder-85199 Aug 06 14:32:32.497277 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [req-e4271dfe-8985-45af-9b7e-ca589d5c75a4 req-d9b54891-a676-46ed-8f36-038b0785a3ba service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033239 Aug 06 14:32:32.498128 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 242/468] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:32:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:32:33.198981 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-c54ff0ee-3875-49e7-9d91-4a096516ec8b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:32:33.199594 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-c54ff0ee-3875-49e7-9d91-4a096516ec8b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 8805d1fa-6d65-45c7-ae75-17e46feccccb] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:33.206128 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c54ff0ee-3875-49e7-9d91-4a096516ec8b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:33.206691 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c54ff0ee-3875-49e7-9d91-4a096516ec8b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:33.207099 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c54ff0ee-3875-49e7-9d91-4a096516ec8b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:33.207810 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c54ff0ee-3875-49e7-9d91-4a096516ec8b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:33.208267 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c54ff0ee-3875-49e7-9d91-4a096516ec8b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:33.208693 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c54ff0ee-3875-49e7-9d91-4a096516ec8b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:33.340340 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-c54ff0ee-3875-49e7-9d91-4a096516ec8b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:32:33.347825 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-c54ff0ee-3875-49e7-9d91-4a096516ec8b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb" status: 200 len: 1370 microversion: 2.1 time: 0.152656 Aug 06 14:32:33.348566 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 227/469] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:32:33 2022] GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:32:34.370035 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-43f5ac8c-b90d-4dcd-892c-8a27d6492ccb tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:32:34.370734 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-43f5ac8c-b90d-4dcd-892c-8a27d6492ccb tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 8805d1fa-6d65-45c7-ae75-17e46feccccb] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:34.376874 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-43f5ac8c-b90d-4dcd-892c-8a27d6492ccb tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:34.377354 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-43f5ac8c-b90d-4dcd-892c-8a27d6492ccb tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:34.377787 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-43f5ac8c-b90d-4dcd-892c-8a27d6492ccb tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:34.378472 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-43f5ac8c-b90d-4dcd-892c-8a27d6492ccb tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:34.378958 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-43f5ac8c-b90d-4dcd-892c-8a27d6492ccb tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:34.379384 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-43f5ac8c-b90d-4dcd-892c-8a27d6492ccb tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:34.509010 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-43f5ac8c-b90d-4dcd-892c-8a27d6492ccb tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:32:34.517717 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-43f5ac8c-b90d-4dcd-892c-8a27d6492ccb tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb" status: 200 len: 1370 microversion: 2.1 time: 0.152794 Aug 06 14:32:34.518280 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 243/470] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:32:34 2022] GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:32:35.540540 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-68a8440f-54b0-42a3-b524-620c4501e080 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:32:35.541055 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-68a8440f-54b0-42a3-b524-620c4501e080 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 8805d1fa-6d65-45c7-ae75-17e46feccccb] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:35.547431 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-68a8440f-54b0-42a3-b524-620c4501e080 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:35.547912 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-68a8440f-54b0-42a3-b524-620c4501e080 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:35.548343 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-68a8440f-54b0-42a3-b524-620c4501e080 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:35.549029 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-68a8440f-54b0-42a3-b524-620c4501e080 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:35.549477 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-68a8440f-54b0-42a3-b524-620c4501e080 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:35.549899 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-68a8440f-54b0-42a3-b524-620c4501e080 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:35.684624 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-68a8440f-54b0-42a3-b524-620c4501e080 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:32:35.691849 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-68a8440f-54b0-42a3-b524-620c4501e080 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb" status: 200 len: 1370 microversion: 2.1 time: 0.155236 Aug 06 14:32:35.692400 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 228/471] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:32:35 2022] GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:32:36.712063 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-69fe852d-5455-41c0-8d48-2ef33cdbfbed tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:32:36.712692 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-69fe852d-5455-41c0-8d48-2ef33cdbfbed tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 8805d1fa-6d65-45c7-ae75-17e46feccccb] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:36.715525 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=1 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:32:36.721195 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-69fe852d-5455-41c0-8d48-2ef33cdbfbed tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:36.721688 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-69fe852d-5455-41c0-8d48-2ef33cdbfbed tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:36.722110 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-69fe852d-5455-41c0-8d48-2ef33cdbfbed tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:36.722798 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-69fe852d-5455-41c0-8d48-2ef33cdbfbed tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:36.723498 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-69fe852d-5455-41c0-8d48-2ef33cdbfbed tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:36.723922 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-69fe852d-5455-41c0-8d48-2ef33cdbfbed tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:36.862100 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-69fe852d-5455-41c0-8d48-2ef33cdbfbed tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:32:36.870277 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-69fe852d-5455-41c0-8d48-2ef33cdbfbed tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb" status: 200 len: 1370 microversion: 2.1 time: 0.162000 Aug 06 14:32:36.870851 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 244/472] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:32:36 2022] GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb => generated 1370 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:32:37.891149 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-718f62d0-aeae-4737-a15d-ecd920fe6b57 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:32:37.891766 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-718f62d0-aeae-4737-a15d-ecd920fe6b57 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 8805d1fa-6d65-45c7-ae75-17e46feccccb] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:37.898961 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-718f62d0-aeae-4737-a15d-ecd920fe6b57 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:37.899459 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-718f62d0-aeae-4737-a15d-ecd920fe6b57 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:37.899886 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-718f62d0-aeae-4737-a15d-ecd920fe6b57 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:37.900561 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-718f62d0-aeae-4737-a15d-ecd920fe6b57 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:37.901007 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-718f62d0-aeae-4737-a15d-ecd920fe6b57 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:37.901424 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-718f62d0-aeae-4737-a15d-ecd920fe6b57 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:38.028388 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-718f62d0-aeae-4737-a15d-ecd920fe6b57 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:32:38.035900 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-718f62d0-aeae-4737-a15d-ecd920fe6b57 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb" status: 200 len: 1370 microversion: 2.1 time: 0.148503 Aug 06 14:32:38.036466 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 229/473] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:32:37 2022] GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb => generated 1370 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:32:39.056091 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-31d848f6-92a9-4e50-8921-eb51fa60d3c9 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:32:39.056643 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-31d848f6-92a9-4e50-8921-eb51fa60d3c9 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 8805d1fa-6d65-45c7-ae75-17e46feccccb] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:39.063280 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-31d848f6-92a9-4e50-8921-eb51fa60d3c9 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:39.063765 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-31d848f6-92a9-4e50-8921-eb51fa60d3c9 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:39.064202 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-31d848f6-92a9-4e50-8921-eb51fa60d3c9 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:39.064884 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-31d848f6-92a9-4e50-8921-eb51fa60d3c9 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:39.065337 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-31d848f6-92a9-4e50-8921-eb51fa60d3c9 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:39.065757 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-31d848f6-92a9-4e50-8921-eb51fa60d3c9 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:39.211363 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-31d848f6-92a9-4e50-8921-eb51fa60d3c9 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:32:39.214900 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:32:39.219295 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-31d848f6-92a9-4e50-8921-eb51fa60d3c9 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb" status: 200 len: 1370 microversion: 2.1 time: 0.167269 Aug 06 14:32:39.219841 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 245/474] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:32:39 2022] GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb => generated 1370 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:32:39.828772 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [req-b4e35be8-38e7-4c74-a160-e3ce0d87422b req-64ce1e7e-df97-41a7-9f6b-ec81af22af8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8805d1fa-6d65-45c7-ae75-17e46feccccb", "name": "network-vif-plugged", "status": "completed", "tag": "6b7de55b-a834-4f94-92da-b46aaa6033a5"}]} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:32:39.834156 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_cell0:SELECT=4 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:32:39.834772 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_cell0:SELECT=6 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:32:39.846109 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-b4e35be8-38e7-4c74-a160-e3ce0d87422b req-64ce1e7e-df97-41a7-9f6b-ec81af22af8c service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:39.846109 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-b4e35be8-38e7-4c74-a160-e3ce0d87422b req-64ce1e7e-df97-41a7-9f6b-ec81af22af8c service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:39.846109 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-b4e35be8-38e7-4c74-a160-e3ce0d87422b req-64ce1e7e-df97-41a7-9f6b-ec81af22af8c service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:39.855469 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.compute.server_external_events [req-b4e35be8-38e7-4c74-a160-e3ce0d87422b req-64ce1e7e-df97-41a7-9f6b-ec81af22af8c service nova] Creating event network-vif-plugged:6b7de55b-a834-4f94-92da-b46aaa6033a5 for instance 8805d1fa-6d65-45c7-ae75-17e46feccccb on hv-cinder-85199 Aug 06 14:32:39.860633 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [req-b4e35be8-38e7-4c74-a160-e3ce0d87422b req-64ce1e7e-df97-41a7-9f6b-ec81af22af8c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035624 Aug 06 14:32:39.861425 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 230/475] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:32:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:32:40.245376 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-bdc80213-f602-4e5e-823e-bb0d3e917da1 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:32:40.246801 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-bdc80213-f602-4e5e-823e-bb0d3e917da1 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 8805d1fa-6d65-45c7-ae75-17e46feccccb] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:40.256957 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_cell0:SELECT=6 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:32:40.259478 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-bdc80213-f602-4e5e-823e-bb0d3e917da1 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:40.260567 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-bdc80213-f602-4e5e-823e-bb0d3e917da1 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:40.261480 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-bdc80213-f602-4e5e-823e-bb0d3e917da1 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:40.262479 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-bdc80213-f602-4e5e-823e-bb0d3e917da1 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:40.263514 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-bdc80213-f602-4e5e-823e-bb0d3e917da1 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:40.264519 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-bdc80213-f602-4e5e-823e-bb0d3e917da1 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:40.464357 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-bdc80213-f602-4e5e-823e-bb0d3e917da1 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:32:40.472009 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-bdc80213-f602-4e5e-823e-bb0d3e917da1 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb" status: 200 len: 1370 microversion: 2.1 time: 0.235429 Aug 06 14:32:40.472676 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 246/476] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:32:40 2022] GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb => generated 1370 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:32:41.086015 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-9e2472c6-0abe-46a8-bfa4-4fdf4bcb7161 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:32:41.086714 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-9e2472c6-0abe-46a8-bfa4-4fdf4bcb7161 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] [instance: cb14f0c5-5a75-4357-b1d3-78a2174cca02] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:41.093205 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9e2472c6-0abe-46a8-bfa4-4fdf4bcb7161 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:41.093684 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9e2472c6-0abe-46a8-bfa4-4fdf4bcb7161 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:41.094179 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9e2472c6-0abe-46a8-bfa4-4fdf4bcb7161 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:41.094884 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9e2472c6-0abe-46a8-bfa4-4fdf4bcb7161 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:41.095340 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9e2472c6-0abe-46a8-bfa4-4fdf4bcb7161 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:41.095759 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9e2472c6-0abe-46a8-bfa4-4fdf4bcb7161 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:41.230456 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-9e2472c6-0abe-46a8-bfa4-4fdf4bcb7161 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96728f2ae5d4885858560396971a1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a30d14e9a4c0ebd2fd8549a09ee44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:32:41.238402 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-9e2472c6-0abe-46a8-bfa4-4fdf4bcb7161 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] 10.222.0.17 "GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02" status: 200 len: 1595 microversion: 2.1 time: 0.157111 Aug 06 14:32:41.238981 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 231/477] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:32:41 2022] GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02 => generated 1595 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:32:41.493946 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-793d74c2-72ea-429a-ab44-2df656d46a08 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:32:41.494550 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-793d74c2-72ea-429a-ab44-2df656d46a08 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 8805d1fa-6d65-45c7-ae75-17e46feccccb] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:41.500995 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-793d74c2-72ea-429a-ab44-2df656d46a08 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:41.501470 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-793d74c2-72ea-429a-ab44-2df656d46a08 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:41.501899 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-793d74c2-72ea-429a-ab44-2df656d46a08 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:41.502577 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-793d74c2-72ea-429a-ab44-2df656d46a08 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:41.503051 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-793d74c2-72ea-429a-ab44-2df656d46a08 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:41.503473 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-793d74c2-72ea-429a-ab44-2df656d46a08 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:41.634052 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-793d74c2-72ea-429a-ab44-2df656d46a08 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:32:41.641592 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-793d74c2-72ea-429a-ab44-2df656d46a08 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb" status: 200 len: 1370 microversion: 2.1 time: 0.151964 Aug 06 14:32:41.642231 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 247/478] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:32:41 2022] GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:32:42.661827 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-106c8a6a-0881-42b6-ad2e-9a04eb247c45 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:32:42.662566 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-106c8a6a-0881-42b6-ad2e-9a04eb247c45 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 8805d1fa-6d65-45c7-ae75-17e46feccccb] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:42.669018 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-106c8a6a-0881-42b6-ad2e-9a04eb247c45 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:42.669504 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-106c8a6a-0881-42b6-ad2e-9a04eb247c45 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:42.669937 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-106c8a6a-0881-42b6-ad2e-9a04eb247c45 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:42.670635 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-106c8a6a-0881-42b6-ad2e-9a04eb247c45 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:42.671118 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-106c8a6a-0881-42b6-ad2e-9a04eb247c45 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:42.671546 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-106c8a6a-0881-42b6-ad2e-9a04eb247c45 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:42.916696 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-106c8a6a-0881-42b6-ad2e-9a04eb247c45 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:32:42.924289 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-106c8a6a-0881-42b6-ad2e-9a04eb247c45 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb" status: 200 len: 1370 microversion: 2.1 time: 0.266247 Aug 06 14:32:42.924886 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 232/479] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:32:42 2022] GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb => generated 1370 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:32:43.282788 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [req-2a5bf050-2f38-4609-9c74-b44438603194 req-205cc1f7-f396-4bb8-a872-efd5f309f47c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb14f0c5-5a75-4357-b1d3-78a2174cca02", "tag": "0bc19d76-ece6-4342-a828-3e88712b2b00"}]} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:32:43.292990 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-2a5bf050-2f38-4609-9c74-b44438603194 req-205cc1f7-f396-4bb8-a872-efd5f309f47c service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:43.294025 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-2a5bf050-2f38-4609-9c74-b44438603194 req-205cc1f7-f396-4bb8-a872-efd5f309f47c service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:43.294559 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-2a5bf050-2f38-4609-9c74-b44438603194 req-205cc1f7-f396-4bb8-a872-efd5f309f47c service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:43.306531 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.compute.server_external_events [req-2a5bf050-2f38-4609-9c74-b44438603194 req-205cc1f7-f396-4bb8-a872-efd5f309f47c service nova] Creating event network-changed:0bc19d76-ece6-4342-a828-3e88712b2b00 for instance cb14f0c5-5a75-4357-b1d3-78a2174cca02 on hv-cinder-85199 Aug 06 14:32:43.312148 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [req-2a5bf050-2f38-4609-9c74-b44438603194 req-205cc1f7-f396-4bb8-a872-efd5f309f47c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033095 Aug 06 14:32:43.312748 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 248/480] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:32:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:32:43.945878 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-bec9e3d4-f592-4a96-9233-5a0c48d78e13 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:32:43.947129 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-bec9e3d4-f592-4a96-9233-5a0c48d78e13 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 8805d1fa-6d65-45c7-ae75-17e46feccccb] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:43.954695 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-bec9e3d4-f592-4a96-9233-5a0c48d78e13 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:43.955476 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-bec9e3d4-f592-4a96-9233-5a0c48d78e13 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:43.956049 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-bec9e3d4-f592-4a96-9233-5a0c48d78e13 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:43.957005 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-bec9e3d4-f592-4a96-9233-5a0c48d78e13 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:43.957699 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-bec9e3d4-f592-4a96-9233-5a0c48d78e13 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:43.959205 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-bec9e3d4-f592-4a96-9233-5a0c48d78e13 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:44.170949 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-bec9e3d4-f592-4a96-9233-5a0c48d78e13 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:32:44.181546 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-bec9e3d4-f592-4a96-9233-5a0c48d78e13 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb" status: 200 len: 1563 microversion: 2.1 time: 0.239403 Aug 06 14:32:44.182457 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 233/481] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:32:43 2022] GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb => generated 1563 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:32:44.202719 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-4330315e-f620-4768-ac85-8e747aceb1e2 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:32:44.203377 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-4330315e-f620-4768-ac85-8e747aceb1e2 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 8805d1fa-6d65-45c7-ae75-17e46feccccb] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:44.210062 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-4330315e-f620-4768-ac85-8e747aceb1e2 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:44.210903 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-4330315e-f620-4768-ac85-8e747aceb1e2 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:44.211590 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-4330315e-f620-4768-ac85-8e747aceb1e2 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:44.212589 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-4330315e-f620-4768-ac85-8e747aceb1e2 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:44.213259 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-4330315e-f620-4768-ac85-8e747aceb1e2 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:44.213898 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-4330315e-f620-4768-ac85-8e747aceb1e2 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:44.307555 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-e38e876a-e9d3-4854-989f-b2af98de4675 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-342308704"}} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:32:44.308087 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-e38e876a-e9d3-4854-989f-b2af98de4675 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] [instance: cb14f0c5-5a75-4357-b1d3-78a2174cca02] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:44.315966 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e38e876a-e9d3-4854-989f-b2af98de4675 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:44.316457 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e38e876a-e9d3-4854-989f-b2af98de4675 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:44.316882 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e38e876a-e9d3-4854-989f-b2af98de4675 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:44.326270 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e38e876a-e9d3-4854-989f-b2af98de4675 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:44.326805 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e38e876a-e9d3-4854-989f-b2af98de4675 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:44.327700 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e38e876a-e9d3-4854-989f-b2af98de4675 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:44.337960 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-4330315e-f620-4768-ac85-8e747aceb1e2 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.139426 Aug 06 14:32:44.347155 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 249/482] 10.222.0.17 () {58 vars in 1275 bytes} [Sat Aug 6 14:32:44 2022] GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb/os-interface => generated 284 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:32:44.506780 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.network.security_group_api [None req-e38e876a-e9d3-4854-989f-b2af98de4675 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Adding security group ef57304b-bead-42ab-8908-384bea5d764c to port 0bc19d76-ece6-4342-a828-3e88712b2b00 Aug 06 14:32:44.846205 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-e38e876a-e9d3-4854-989f-b2af98de4675 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] 10.222.0.17 "POST /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02/action" status: 202 len: 0 microversion: 2.1 time: 0.542307 Aug 06 14:32:44.849388 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 234/483] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Aug 6 14:32:44 2022] POST /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02/action => generated 0 bytes in 547 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 06 14:32:44.855780 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-2155b1b6-6231-41e8-bdee-b1f8c22807b8 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:32:44.856607 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-2155b1b6-6231-41e8-bdee-b1f8c22807b8 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] [instance: cb14f0c5-5a75-4357-b1d3-78a2174cca02] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:44.862893 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2155b1b6-6231-41e8-bdee-b1f8c22807b8 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:44.863398 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2155b1b6-6231-41e8-bdee-b1f8c22807b8 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:44.863821 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2155b1b6-6231-41e8-bdee-b1f8c22807b8 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:44.864670 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2155b1b6-6231-41e8-bdee-b1f8c22807b8 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:44.865118 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2155b1b6-6231-41e8-bdee-b1f8c22807b8 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:44.865535 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2155b1b6-6231-41e8-bdee-b1f8c22807b8 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:45.145311 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-2155b1b6-6231-41e8-bdee-b1f8c22807b8 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96728f2ae5d4885858560396971a1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a30d14e9a4c0ebd2fd8549a09ee44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:32:45.153972 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-2155b1b6-6231-41e8-bdee-b1f8c22807b8 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] 10.222.0.17 "GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02" status: 200 len: 1760 microversion: 2.1 time: 0.303771 Aug 06 14:32:45.154815 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 250/484] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:32:44 2022] GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02 => generated 1760 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:32:45.327793 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [req-82e7945b-d645-46a4-aac2-c74ffd20eead req-a4fde80d-9165-41c0-b881-65908d3bf52f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb14f0c5-5a75-4357-b1d3-78a2174cca02", "tag": "0bc19d76-ece6-4342-a828-3e88712b2b00"}]} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:32:45.349570 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-82e7945b-d645-46a4-aac2-c74ffd20eead req-a4fde80d-9165-41c0-b881-65908d3bf52f service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:45.350272 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-82e7945b-d645-46a4-aac2-c74ffd20eead req-a4fde80d-9165-41c0-b881-65908d3bf52f service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:45.351251 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-82e7945b-d645-46a4-aac2-c74ffd20eead req-a4fde80d-9165-41c0-b881-65908d3bf52f service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:45.365628 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.compute.server_external_events [req-82e7945b-d645-46a4-aac2-c74ffd20eead req-a4fde80d-9165-41c0-b881-65908d3bf52f service nova] Creating event network-changed:0bc19d76-ece6-4342-a828-3e88712b2b00 for instance cb14f0c5-5a75-4357-b1d3-78a2174cca02 on hv-cinder-85199 Aug 06 14:32:45.373647 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [req-82e7945b-d645-46a4-aac2-c74ffd20eead req-a4fde80d-9165-41c0-b881-65908d3bf52f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049066 Aug 06 14:32:45.374537 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 235/485] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:32:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:32:45.455961 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [req-9cd5796b-62b4-44bd-b65c-cca988f26f1a req-bb6f9106-9d86-49bf-b669-27fcdd9a8ebb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8805d1fa-6d65-45c7-ae75-17e46feccccb", "tag": "6b7de55b-a834-4f94-92da-b46aaa6033a5"}]} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:32:45.466246 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-9cd5796b-62b4-44bd-b65c-cca988f26f1a req-bb6f9106-9d86-49bf-b669-27fcdd9a8ebb service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:45.466715 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-9cd5796b-62b4-44bd-b65c-cca988f26f1a req-bb6f9106-9d86-49bf-b669-27fcdd9a8ebb service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:45.467172 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-9cd5796b-62b4-44bd-b65c-cca988f26f1a req-bb6f9106-9d86-49bf-b669-27fcdd9a8ebb service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:45.479281 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.compute.server_external_events [req-9cd5796b-62b4-44bd-b65c-cca988f26f1a req-bb6f9106-9d86-49bf-b669-27fcdd9a8ebb service nova] Creating event network-changed:6b7de55b-a834-4f94-92da-b46aaa6033a5 for instance 8805d1fa-6d65-45c7-ae75-17e46feccccb on hv-cinder-85199 Aug 06 14:32:45.484057 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [req-9cd5796b-62b4-44bd-b65c-cca988f26f1a req-bb6f9106-9d86-49bf-b669-27fcdd9a8ebb service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031694 Aug 06 14:32:45.484987 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 251/486] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:32:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:32:50.668634 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-28732040-3443-4feb-9717-334641985fe6 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b60dce9f-769d-4b2b-855f-0041ac92ac2a", "device": "/dev/sdb"}} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:32:50.671519 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-28732040-3443-4feb-9717-334641985fe6 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] [instance: 81104a95-fe7a-4983-b5c5-2ad4d2463832] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:32:50.677519 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-28732040-3443-4feb-9717-334641985fe6 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:50.677997 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-28732040-3443-4feb-9717-334641985fe6 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:50.678428 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-28732040-3443-4feb-9717-334641985fe6 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:50.679846 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-28732040-3443-4feb-9717-334641985fe6 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:32:50.680307 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-28732040-3443-4feb-9717-334641985fe6 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:32:50.680729 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-28732040-3443-4feb-9717-334641985fe6 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:32:50.947364 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-28732040-3443-4feb-9717-334641985fe6 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] 10.222.0.17 "POST /compute/v2.1/servers/81104a95-fe7a-4983-b5c5-2ad4d2463832/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283993 Aug 06 14:32:50.947956 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 236/487] 10.222.0.17 () {60 vars in 1323 bytes} [Sat Aug 6 14:32:50 2022] POST /compute/v2.1/servers/81104a95-fe7a-4983-b5c5-2ad4d2463832/os-volume_attachments => generated 194 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:33:18.502344 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_api:SELECT=15 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:33:18.503110 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_cell1:SELECT=26 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:33:18.507726 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-ed416bc4-a5d8-4b0d-af0d-5c488f30b4b4 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:33:18.508302 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-ed416bc4-a5d8-4b0d-af0d-5c488f30b4b4 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:33:18.515087 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ed416bc4-a5d8-4b0d-af0d-5c488f30b4b4 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:18.515563 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ed416bc4-a5d8-4b0d-af0d-5c488f30b4b4 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:18.516000 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ed416bc4-a5d8-4b0d-af0d-5c488f30b4b4 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:18.516681 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ed416bc4-a5d8-4b0d-af0d-5c488f30b4b4 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:18.517128 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ed416bc4-a5d8-4b0d-af0d-5c488f30b4b4 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:18.517550 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ed416bc4-a5d8-4b0d-af0d-5c488f30b4b4 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:18.540185 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-ed416bc4-a5d8-4b0d-af0d-5c488f30b4b4 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8/ips" status: 200 len: 152 microversion: 2.20 time: 0.039431 Aug 06 14:33:18.540732 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 252/488] 10.222.0.17 () {60 vars in 1289 bytes} [Sat Aug 6 14:33:18 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8/ips => generated 152 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 14:33:22.437699 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:33:22.438462 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:33:22.443383 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-f1457691-f617-4846-9118-b03985bda404 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:33:22.444083 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-f1457691-f617-4846-9118-b03985bda404 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:33:22.451808 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f1457691-f617-4846-9118-b03985bda404 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:22.452288 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f1457691-f617-4846-9118-b03985bda404 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:22.452717 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f1457691-f617-4846-9118-b03985bda404 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:22.453399 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f1457691-f617-4846-9118-b03985bda404 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:22.453849 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f1457691-f617-4846-9118-b03985bda404 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:22.454270 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f1457691-f617-4846-9118-b03985bda404 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:22.477772 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.objects.instance [None req-f1457691-f617-4846-9118-b03985bda404 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lazy-loading 'flavor' on Instance uuid 5cf29bae-83f8-43e3-9118-0fea5a019ff8 {{(pid=117838) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 14:33:22.646738 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-f1457691-f617-4846-9118-b03985bda404 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "POST /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8/action" status: 202 len: 0 microversion: 2.20 time: 0.210342 Aug 06 14:33:22.647345 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 237/489] 10.222.0.17 () {62 vars in 1319 bytes} [Sat Aug 6 14:33:22 2022] POST /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 06 14:33:22.656045 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-7127a948-6083-4754-a598-b712b6aa1391 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:33:22.656652 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-7127a948-6083-4754-a598-b712b6aa1391 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:33:22.662990 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7127a948-6083-4754-a598-b712b6aa1391 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:22.664163 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7127a948-6083-4754-a598-b712b6aa1391 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:22.664600 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7127a948-6083-4754-a598-b712b6aa1391 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:22.665283 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7127a948-6083-4754-a598-b712b6aa1391 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:22.665734 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7127a948-6083-4754-a598-b712b6aa1391 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:22.666147 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7127a948-6083-4754-a598-b712b6aa1391 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:22.799449 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-7127a948-6083-4754-a598-b712b6aa1391 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:22.807632 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-7127a948-6083-4754-a598-b712b6aa1391 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:22.809136 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-7127a948-6083-4754-a598-b712b6aa1391 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:22.810282 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-7127a948-6083-4754-a598-b712b6aa1391 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1725 microversion: 2.20 time: 0.158092 Aug 06 14:33:22.810819 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 253/490] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:33:22 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:33:23.834794 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-4d7ebc0a-a294-436e-a099-953f266d99ba tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:33:23.835510 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-4d7ebc0a-a294-436e-a099-953f266d99ba tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:33:23.842289 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4d7ebc0a-a294-436e-a099-953f266d99ba tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:23.842764 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4d7ebc0a-a294-436e-a099-953f266d99ba tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:23.843220 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4d7ebc0a-a294-436e-a099-953f266d99ba tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:23.843895 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4d7ebc0a-a294-436e-a099-953f266d99ba tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:23.844341 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4d7ebc0a-a294-436e-a099-953f266d99ba tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:23.844758 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4d7ebc0a-a294-436e-a099-953f266d99ba tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:23.973993 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-4d7ebc0a-a294-436e-a099-953f266d99ba tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:23.982325 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-4d7ebc0a-a294-436e-a099-953f266d99ba tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:23.983843 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-4d7ebc0a-a294-436e-a099-953f266d99ba tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:23.984983 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-4d7ebc0a-a294-436e-a099-953f266d99ba tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1725 microversion: 2.20 time: 0.154941 Aug 06 14:33:23.985535 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 238/491] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:33:23 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:33:25.006501 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-0397a2b7-350a-4ca2-9662-fb92e165c669 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:33:25.007130 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-0397a2b7-350a-4ca2-9662-fb92e165c669 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:33:25.014011 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0397a2b7-350a-4ca2-9662-fb92e165c669 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:25.014459 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0397a2b7-350a-4ca2-9662-fb92e165c669 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:25.014909 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0397a2b7-350a-4ca2-9662-fb92e165c669 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:25.015635 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0397a2b7-350a-4ca2-9662-fb92e165c669 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:25.016079 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0397a2b7-350a-4ca2-9662-fb92e165c669 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:25.016494 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0397a2b7-350a-4ca2-9662-fb92e165c669 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:25.149746 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-0397a2b7-350a-4ca2-9662-fb92e165c669 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:25.158090 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-0397a2b7-350a-4ca2-9662-fb92e165c669 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:25.159645 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-0397a2b7-350a-4ca2-9662-fb92e165c669 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:25.160788 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-0397a2b7-350a-4ca2-9662-fb92e165c669 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1725 microversion: 2.20 time: 0.158146 Aug 06 14:33:25.161330 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 254/492] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:33:25 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:33:26.184643 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-6ca1ff1c-570a-4f43-bfa8-267e71bb281d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:33:26.185251 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-6ca1ff1c-570a-4f43-bfa8-267e71bb281d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:33:26.191866 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6ca1ff1c-570a-4f43-bfa8-267e71bb281d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:26.192347 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6ca1ff1c-570a-4f43-bfa8-267e71bb281d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:26.192776 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6ca1ff1c-570a-4f43-bfa8-267e71bb281d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:26.193459 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6ca1ff1c-570a-4f43-bfa8-267e71bb281d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:26.193910 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6ca1ff1c-570a-4f43-bfa8-267e71bb281d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:26.194328 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6ca1ff1c-570a-4f43-bfa8-267e71bb281d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:26.321555 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-6ca1ff1c-570a-4f43-bfa8-267e71bb281d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:26.329654 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-6ca1ff1c-570a-4f43-bfa8-267e71bb281d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:26.331207 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-6ca1ff1c-570a-4f43-bfa8-267e71bb281d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:26.332406 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-6ca1ff1c-570a-4f43-bfa8-267e71bb281d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1725 microversion: 2.20 time: 0.151902 Aug 06 14:33:26.332965 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 239/493] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:33:26 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:33:26.910014 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-d396b937-543e-4772-88e5-e30a4673318d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:33:26.910506 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-d396b937-543e-4772-88e5-e30a4673318d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6e717f01-c854-444e-9872-51e2c1c78987] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:33:26.917398 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d396b937-543e-4772-88e5-e30a4673318d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:26.917869 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d396b937-543e-4772-88e5-e30a4673318d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:26.918291 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d396b937-543e-4772-88e5-e30a4673318d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:26.918999 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d396b937-543e-4772-88e5-e30a4673318d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:26.919443 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d396b937-543e-4772-88e5-e30a4673318d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:26.919857 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d396b937-543e-4772-88e5-e30a4673318d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:26.941845 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-d396b937-543e-4772-88e5-e30a4673318d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987/ips" status: 200 len: 150 microversion: 2.1 time: 0.035599 Aug 06 14:33:26.942374 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 255/494] 10.222.0.17 () {58 vars in 1248 bytes} [Sat Aug 6 14:33:26 2022] GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:33:27.355561 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-a7a097e6-8226-490d-925b-7a5d37288676 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:33:27.356128 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-a7a097e6-8226-490d-925b-7a5d37288676 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:33:27.362401 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a7a097e6-8226-490d-925b-7a5d37288676 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:27.362898 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a7a097e6-8226-490d-925b-7a5d37288676 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:27.363338 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a7a097e6-8226-490d-925b-7a5d37288676 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:27.364022 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a7a097e6-8226-490d-925b-7a5d37288676 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:27.364470 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a7a097e6-8226-490d-925b-7a5d37288676 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:27.364889 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a7a097e6-8226-490d-925b-7a5d37288676 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:27.494517 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-a7a097e6-8226-490d-925b-7a5d37288676 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:27.502485 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-a7a097e6-8226-490d-925b-7a5d37288676 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:27.504012 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-a7a097e6-8226-490d-925b-7a5d37288676 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:27.505162 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-a7a097e6-8226-490d-925b-7a5d37288676 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1725 microversion: 2.20 time: 0.153544 Aug 06 14:33:27.505713 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 240/495] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:33:27 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:33:28.528876 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-e960b644-435c-4694-aca2-30676027d495 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:33:28.529513 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-e960b644-435c-4694-aca2-30676027d495 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:33:28.536155 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e960b644-435c-4694-aca2-30676027d495 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:28.536637 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e960b644-435c-4694-aca2-30676027d495 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:28.537071 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e960b644-435c-4694-aca2-30676027d495 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:28.537764 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e960b644-435c-4694-aca2-30676027d495 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:28.538245 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e960b644-435c-4694-aca2-30676027d495 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:28.538667 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e960b644-435c-4694-aca2-30676027d495 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:28.669644 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-e960b644-435c-4694-aca2-30676027d495 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:28.677636 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-e960b644-435c-4694-aca2-30676027d495 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:28.679205 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-e960b644-435c-4694-aca2-30676027d495 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:28.680393 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-e960b644-435c-4694-aca2-30676027d495 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1725 microversion: 2.20 time: 0.155868 Aug 06 14:33:28.680968 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 256/496] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:33:28 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:33:29.705897 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-7cdff29e-6676-4852-b23c-ed58fdb59abd tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:33:29.706514 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-7cdff29e-6676-4852-b23c-ed58fdb59abd tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:33:29.712817 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7cdff29e-6676-4852-b23c-ed58fdb59abd tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:29.713291 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7cdff29e-6676-4852-b23c-ed58fdb59abd tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:29.713713 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7cdff29e-6676-4852-b23c-ed58fdb59abd tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:29.714417 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7cdff29e-6676-4852-b23c-ed58fdb59abd tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:29.714861 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7cdff29e-6676-4852-b23c-ed58fdb59abd tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:29.715299 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7cdff29e-6676-4852-b23c-ed58fdb59abd tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:29.840718 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-7cdff29e-6676-4852-b23c-ed58fdb59abd tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:29.848580 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-7cdff29e-6676-4852-b23c-ed58fdb59abd tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:29.850058 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-7cdff29e-6676-4852-b23c-ed58fdb59abd tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:29.851224 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-7cdff29e-6676-4852-b23c-ed58fdb59abd tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1725 microversion: 2.20 time: 0.149146 Aug 06 14:33:29.852277 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 241/497] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:33:29 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:33:30.874076 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-81481600-28ec-4971-8d68-944a8646cdab tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:33:30.874679 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-81481600-28ec-4971-8d68-944a8646cdab tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:33:30.881102 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-81481600-28ec-4971-8d68-944a8646cdab tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:30.881586 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-81481600-28ec-4971-8d68-944a8646cdab tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:30.882015 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-81481600-28ec-4971-8d68-944a8646cdab tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:30.883671 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-81481600-28ec-4971-8d68-944a8646cdab tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:30.884175 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-81481600-28ec-4971-8d68-944a8646cdab tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:30.884600 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-81481600-28ec-4971-8d68-944a8646cdab tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:31.014115 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-81481600-28ec-4971-8d68-944a8646cdab tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:31.022317 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-81481600-28ec-4971-8d68-944a8646cdab tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:31.023897 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-81481600-28ec-4971-8d68-944a8646cdab tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:31.025092 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-81481600-28ec-4971-8d68-944a8646cdab tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1725 microversion: 2.20 time: 0.154881 Aug 06 14:33:31.025658 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 257/498] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:33:30 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:33:32.048686 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-c114d096-5d6a-4b7b-ba60-beeff048b9be tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:33:32.049218 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-c114d096-5d6a-4b7b-ba60-beeff048b9be tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:33:32.055596 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c114d096-5d6a-4b7b-ba60-beeff048b9be tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:32.056326 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c114d096-5d6a-4b7b-ba60-beeff048b9be tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:32.056761 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c114d096-5d6a-4b7b-ba60-beeff048b9be tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:32.057442 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c114d096-5d6a-4b7b-ba60-beeff048b9be tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:32.057891 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c114d096-5d6a-4b7b-ba60-beeff048b9be tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:32.062782 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c114d096-5d6a-4b7b-ba60-beeff048b9be tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:32.194178 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-c114d096-5d6a-4b7b-ba60-beeff048b9be tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:32.202742 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-c114d096-5d6a-4b7b-ba60-beeff048b9be tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:32.204274 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-c114d096-5d6a-4b7b-ba60-beeff048b9be tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:32.205414 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-c114d096-5d6a-4b7b-ba60-beeff048b9be tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1725 microversion: 2.20 time: 0.160707 Aug 06 14:33:32.205967 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 242/499] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:33:32 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:33:33.228603 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-8266deac-df71-40a9-ac3f-c46fe64259a4 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:33:33.229252 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-8266deac-df71-40a9-ac3f-c46fe64259a4 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:33:33.235309 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8266deac-df71-40a9-ac3f-c46fe64259a4 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:33.235790 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8266deac-df71-40a9-ac3f-c46fe64259a4 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:33.236224 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8266deac-df71-40a9-ac3f-c46fe64259a4 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:33.236907 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8266deac-df71-40a9-ac3f-c46fe64259a4 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:33.237363 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8266deac-df71-40a9-ac3f-c46fe64259a4 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:33.237785 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8266deac-df71-40a9-ac3f-c46fe64259a4 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:33.362064 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-8266deac-df71-40a9-ac3f-c46fe64259a4 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:33.369944 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-8266deac-df71-40a9-ac3f-c46fe64259a4 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:33.371486 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-8266deac-df71-40a9-ac3f-c46fe64259a4 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:33.372644 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-8266deac-df71-40a9-ac3f-c46fe64259a4 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1725 microversion: 2.20 time: 0.148567 Aug 06 14:33:33.373190 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 258/500] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:33:33 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:33:34.395906 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-4ef4f4d5-f22a-40d0-85e6-0167e5fa5af2 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:33:34.396509 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-4ef4f4d5-f22a-40d0-85e6-0167e5fa5af2 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:33:34.403665 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4ef4f4d5-f22a-40d0-85e6-0167e5fa5af2 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:34.404144 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4ef4f4d5-f22a-40d0-85e6-0167e5fa5af2 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:34.404573 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4ef4f4d5-f22a-40d0-85e6-0167e5fa5af2 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:34.405261 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4ef4f4d5-f22a-40d0-85e6-0167e5fa5af2 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:34.405710 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4ef4f4d5-f22a-40d0-85e6-0167e5fa5af2 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:34.406128 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4ef4f4d5-f22a-40d0-85e6-0167e5fa5af2 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:34.535855 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-4ef4f4d5-f22a-40d0-85e6-0167e5fa5af2 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:34.544436 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-4ef4f4d5-f22a-40d0-85e6-0167e5fa5af2 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:34.546054 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-4ef4f4d5-f22a-40d0-85e6-0167e5fa5af2 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:34.547128 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-4ef4f4d5-f22a-40d0-85e6-0167e5fa5af2 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1725 microversion: 2.20 time: 0.155086 Aug 06 14:33:34.547877 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 243/501] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:33:34 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:33:34.603974 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-dd1b135e-460e-425d-bfdd-54fa17158cd3 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9e8a5fc3-29f8-4032-ac5f-a0c16cb37485"}} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:33:34.606318 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-dd1b135e-460e-425d-bfdd-54fa17158cd3 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6e717f01-c854-444e-9872-51e2c1c78987] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:33:34.612834 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-dd1b135e-460e-425d-bfdd-54fa17158cd3 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:34.613308 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-dd1b135e-460e-425d-bfdd-54fa17158cd3 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:34.613734 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-dd1b135e-460e-425d-bfdd-54fa17158cd3 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:34.614409 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-dd1b135e-460e-425d-bfdd-54fa17158cd3 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:34.614854 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-dd1b135e-460e-425d-bfdd-54fa17158cd3 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:34.615323 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-dd1b135e-460e-425d-bfdd-54fa17158cd3 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:34.925462 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-dd1b135e-460e-425d-bfdd-54fa17158cd3 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "POST /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.325924 Aug 06 14:33:34.926053 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 259/502] 10.222.0.17 () {60 vars in 1323 bytes} [Sat Aug 6 14:33:34 2022] POST /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987/os-volume_attachments => generated 194 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:33:35.338858 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-1edb7dcf-5009-4154-b104-e221acc01381 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:33:35.339377 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-1edb7dcf-5009-4154-b104-e221acc01381 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] [instance: 81104a95-fe7a-4983-b5c5-2ad4d2463832] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:33:35.345178 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1edb7dcf-5009-4154-b104-e221acc01381 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:35.345661 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1edb7dcf-5009-4154-b104-e221acc01381 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:35.346096 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1edb7dcf-5009-4154-b104-e221acc01381 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:35.346785 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1edb7dcf-5009-4154-b104-e221acc01381 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:35.347267 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1edb7dcf-5009-4154-b104-e221acc01381 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:35.347691 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1edb7dcf-5009-4154-b104-e221acc01381 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:35.472666 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.objects.instance [None req-1edb7dcf-5009-4154-b104-e221acc01381 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lazy-loading 'services' on Instance uuid 81104a95-fe7a-4983-b5c5-2ad4d2463832 {{(pid=117838) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 14:33:35.571353 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-c94840a4-de35-4b62-816a-ee92922608ef tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:33:35.572218 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-c94840a4-de35-4b62-816a-ee92922608ef tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:33:35.579028 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c94840a4-de35-4b62-816a-ee92922608ef tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:35.579751 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c94840a4-de35-4b62-816a-ee92922608ef tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:35.580188 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c94840a4-de35-4b62-816a-ee92922608ef tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:35.580884 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c94840a4-de35-4b62-816a-ee92922608ef tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:35.581338 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c94840a4-de35-4b62-816a-ee92922608ef tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:35.581757 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c94840a4-de35-4b62-816a-ee92922608ef tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:35.586110 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-1edb7dcf-5009-4154-b104-e221acc01381 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] 10.222.0.17 "DELETE /compute/v2.1/servers/81104a95-fe7a-4983-b5c5-2ad4d2463832/os-volume_attachments/b60dce9f-769d-4b2b-855f-0041ac92ac2a" status: 202 len: 0 microversion: 2.1 time: 0.250893 Aug 06 14:33:35.587024 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 244/503] 10.222.0.17 () {58 vars in 1416 bytes} [Sat Aug 6 14:33:35 2022] DELETE /compute/v2.1/servers/81104a95-fe7a-4983-b5c5-2ad4d2463832/os-volume_attachments/b60dce9f-769d-4b2b-855f-0041ac92ac2a => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 06 14:33:35.723267 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-c94840a4-de35-4b62-816a-ee92922608ef tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:35.731734 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-c94840a4-de35-4b62-816a-ee92922608ef tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:35.733224 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-c94840a4-de35-4b62-816a-ee92922608ef tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:35.734381 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-c94840a4-de35-4b62-816a-ee92922608ef tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1725 microversion: 2.20 time: 0.168511 Aug 06 14:33:35.734958 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 260/504] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:33:35 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 14:33:36.759214 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-c08bae25-84a6-49e4-b970-2adfa2772597 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:33:36.759909 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-c08bae25-84a6-49e4-b970-2adfa2772597 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:33:36.766386 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c08bae25-84a6-49e4-b970-2adfa2772597 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:36.766861 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c08bae25-84a6-49e4-b970-2adfa2772597 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:36.767318 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c08bae25-84a6-49e4-b970-2adfa2772597 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:36.767999 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c08bae25-84a6-49e4-b970-2adfa2772597 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:36.768450 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c08bae25-84a6-49e4-b970-2adfa2772597 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:36.768865 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c08bae25-84a6-49e4-b970-2adfa2772597 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:36.900075 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-c08bae25-84a6-49e4-b970-2adfa2772597 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:36.907915 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-c08bae25-84a6-49e4-b970-2adfa2772597 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:36.909438 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-c08bae25-84a6-49e4-b970-2adfa2772597 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:36.910596 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-c08bae25-84a6-49e4-b970-2adfa2772597 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1725 microversion: 2.20 time: 0.156456 Aug 06 14:33:36.911177 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 245/505] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:33:36 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:33:37.896713 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 14:33:37.897192 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Sat Aug 6 14:33:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 14:33:37.933064 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-aad43fb1-b236-4881-9106-9ddef790c88d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:33:37.933716 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-aad43fb1-b236-4881-9106-9ddef790c88d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:33:37.940027 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-aad43fb1-b236-4881-9106-9ddef790c88d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:37.940503 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-aad43fb1-b236-4881-9106-9ddef790c88d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:37.940935 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-aad43fb1-b236-4881-9106-9ddef790c88d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:37.941609 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-aad43fb1-b236-4881-9106-9ddef790c88d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:37.942059 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-aad43fb1-b236-4881-9106-9ddef790c88d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:37.942478 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-aad43fb1-b236-4881-9106-9ddef790c88d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:38.068157 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-aad43fb1-b236-4881-9106-9ddef790c88d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:38.076480 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-aad43fb1-b236-4881-9106-9ddef790c88d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:38.078036 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-aad43fb1-b236-4881-9106-9ddef790c88d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:38.079376 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-aad43fb1-b236-4881-9106-9ddef790c88d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1725 microversion: 2.20 time: 0.150286 Aug 06 14:33:38.079926 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 261/506] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:33:37 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 14:33:39.102734 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-8437fe15-e842-44b7-8ba9-c8931e751d45 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:33:39.103326 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-8437fe15-e842-44b7-8ba9-c8931e751d45 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:33:39.110147 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8437fe15-e842-44b7-8ba9-c8931e751d45 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:39.110620 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8437fe15-e842-44b7-8ba9-c8931e751d45 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:39.111099 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8437fe15-e842-44b7-8ba9-c8931e751d45 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:39.111774 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8437fe15-e842-44b7-8ba9-c8931e751d45 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:39.112218 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8437fe15-e842-44b7-8ba9-c8931e751d45 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:39.112629 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8437fe15-e842-44b7-8ba9-c8931e751d45 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:39.240617 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-8437fe15-e842-44b7-8ba9-c8931e751d45 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:39.248399 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-8437fe15-e842-44b7-8ba9-c8931e751d45 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:39.249881 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-8437fe15-e842-44b7-8ba9-c8931e751d45 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:39.251054 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-8437fe15-e842-44b7-8ba9-c8931e751d45 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1725 microversion: 2.20 time: 0.152227 Aug 06 14:33:39.251602 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 246/507] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:33:39 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:33:40.273571 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-455678bf-f4b6-4267-866c-04c7c4c4402f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:33:40.274203 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-455678bf-f4b6-4267-866c-04c7c4c4402f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:33:40.280792 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-455678bf-f4b6-4267-866c-04c7c4c4402f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:40.281272 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-455678bf-f4b6-4267-866c-04c7c4c4402f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:40.281705 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-455678bf-f4b6-4267-866c-04c7c4c4402f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:40.282390 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-455678bf-f4b6-4267-866c-04c7c4c4402f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:40.282845 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-455678bf-f4b6-4267-866c-04c7c4c4402f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:40.283295 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-455678bf-f4b6-4267-866c-04c7c4c4402f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:40.413994 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-455678bf-f4b6-4267-866c-04c7c4c4402f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:40.422366 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-455678bf-f4b6-4267-866c-04c7c4c4402f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:40.423875 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-455678bf-f4b6-4267-866c-04c7c4c4402f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:40.425009 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-455678bf-f4b6-4267-866c-04c7c4c4402f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1725 microversion: 2.20 time: 0.155433 Aug 06 14:33:40.425553 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 262/508] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:33:40 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:33:41.448709 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-5ac46380-38a2-417d-ac52-143b607f4136 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:33:41.449369 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-5ac46380-38a2-417d-ac52-143b607f4136 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:33:41.455300 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5ac46380-38a2-417d-ac52-143b607f4136 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:41.455775 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5ac46380-38a2-417d-ac52-143b607f4136 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:41.456201 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5ac46380-38a2-417d-ac52-143b607f4136 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:41.456882 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5ac46380-38a2-417d-ac52-143b607f4136 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:41.457331 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5ac46380-38a2-417d-ac52-143b607f4136 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:41.457749 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5ac46380-38a2-417d-ac52-143b607f4136 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:41.595641 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-5ac46380-38a2-417d-ac52-143b607f4136 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:41.603958 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-5ac46380-38a2-417d-ac52-143b607f4136 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:41.605449 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-5ac46380-38a2-417d-ac52-143b607f4136 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:41.606587 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-5ac46380-38a2-417d-ac52-143b607f4136 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1725 microversion: 2.20 time: 0.162436 Aug 06 14:33:41.607148 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 247/509] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:33:41 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:33:42.629563 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-09837078-904a-4cac-9a38-597bb1d7d3ed tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:33:42.630079 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-09837078-904a-4cac-9a38-597bb1d7d3ed tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:33:42.636468 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-09837078-904a-4cac-9a38-597bb1d7d3ed tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:42.636950 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-09837078-904a-4cac-9a38-597bb1d7d3ed tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:42.637386 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-09837078-904a-4cac-9a38-597bb1d7d3ed tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:42.638109 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-09837078-904a-4cac-9a38-597bb1d7d3ed tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:42.638560 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-09837078-904a-4cac-9a38-597bb1d7d3ed tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:42.639018 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-09837078-904a-4cac-9a38-597bb1d7d3ed tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:42.767651 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-09837078-904a-4cac-9a38-597bb1d7d3ed tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:42.775946 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-09837078-904a-4cac-9a38-597bb1d7d3ed tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:42.777443 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-09837078-904a-4cac-9a38-597bb1d7d3ed tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:42.778584 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-09837078-904a-4cac-9a38-597bb1d7d3ed tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1725 microversion: 2.20 time: 0.153006 Aug 06 14:33:42.779188 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 263/510] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:33:42 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:33:43.523610 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-923ea082-a1a8-44ee-91ea-53d1c14faeff tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Action: 'create', calling method: .version_select at 0x7fbab178de50>, body: {"keypair": {"name": "tempest-keypair-1672036177", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK/3iS4DCM/MkjZ22j6hPva2I72Oxt6Hd69uBv4/hIg6XlM9Tjw6UiXaNxo4SSPhjMUVTFD8gEsnhhPXRGbYlQQ9qfoPEPFBUYfd3lMI6ViKAEoFwhuLFcnA+4rpRaxQaA=="}} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:33:43.539034 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.quota [None req-923ea082-a1a8-44ee-91ea-53d1c14faeff tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Getting quotas for project 96a7bb12d3ed4d1db2a58a03472483c2. Resources: {'key_pairs'} {{(pid=117838) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 14:33:43.543593 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.quota [None req-923ea082-a1a8-44ee-91ea-53d1c14faeff tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Getting quotas for user 5378c85cd31c42dfbc39ce738a8b6dde and project 96a7bb12d3ed4d1db2a58a03472483c2. Resources: {'key_pairs'} {{(pid=117838) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 14:33:43.569356 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-923ea082-a1a8-44ee-91ea-53d1c14faeff tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049559 Aug 06 14:33:43.569951 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 248/511] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Aug 6 14:33:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:33:43.802192 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-1a44ea90-429e-4cb9-81a2-60904a26804c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:33:43.804037 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-1a44ea90-429e-4cb9-81a2-60904a26804c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:33:43.816394 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1a44ea90-429e-4cb9-81a2-60904a26804c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:43.827085 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1a44ea90-429e-4cb9-81a2-60904a26804c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:43.827561 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1a44ea90-429e-4cb9-81a2-60904a26804c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:43.828706 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1a44ea90-429e-4cb9-81a2-60904a26804c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:43.829768 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1a44ea90-429e-4cb9-81a2-60904a26804c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:43.830201 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1a44ea90-429e-4cb9-81a2-60904a26804c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:44.031012 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-1a44ea90-429e-4cb9-81a2-60904a26804c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:44.041695 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-1a44ea90-429e-4cb9-81a2-60904a26804c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:44.043234 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-1a44ea90-429e-4cb9-81a2-60904a26804c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:44.044524 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-1a44ea90-429e-4cb9-81a2-60904a26804c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1725 microversion: 2.20 time: 0.246379 Aug 06 14:33:44.045079 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 264/512] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:33:43 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1725 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 14:33:44.988213 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-16260354-ac24-4caf-ab01-0d1c672b8323 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-681402448", "imageRef": "13d7ee60-c9c3-43ee-9861-a9192a114a77", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9b050990-e64f-42d3-84c7-d36c3ef1c328"}], "security_groups": [{"name": "tempest-securitygroup--862483584"}], "key_name": "tempest-keypair-1672036177", "user_data": "}} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:33:45.070414 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-233dcf4d-7f1b-4282-a891-66281fdc2285 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:33:45.071057 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-233dcf4d-7f1b-4282-a891-66281fdc2285 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:33:45.078338 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-233dcf4d-7f1b-4282-a891-66281fdc2285 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:45.078848 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-233dcf4d-7f1b-4282-a891-66281fdc2285 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:45.079338 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-233dcf4d-7f1b-4282-a891-66281fdc2285 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:45.080024 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-233dcf4d-7f1b-4282-a891-66281fdc2285 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:45.080653 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-233dcf4d-7f1b-4282-a891-66281fdc2285 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:45.081074 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-233dcf4d-7f1b-4282-a891-66281fdc2285 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:45.100225 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.network.neutron [None req-16260354-ac24-4caf-ab01-0d1c672b8323 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] validate_networks() for [('9b050990-e64f-42d3-84c7-d36c3ef1c328', None, None, None, None, None)] {{(pid=117838) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 14:33:45.226355 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-233dcf4d-7f1b-4282-a891-66281fdc2285 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:45.235690 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-233dcf4d-7f1b-4282-a891-66281fdc2285 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:45.237241 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-233dcf4d-7f1b-4282-a891-66281fdc2285 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:45.238396 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-233dcf4d-7f1b-4282-a891-66281fdc2285 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1746 microversion: 2.20 time: 0.172172 Aug 06 14:33:45.238971 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 265/513] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:33:45 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1746 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 14:33:45.243635 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-37abbf34-c24d-4124-95aa-d9bf86b3e068 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:33:45.244663 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-37abbf34-c24d-4124-95aa-d9bf86b3e068 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] [instance: 81104a95-fe7a-4983-b5c5-2ad4d2463832] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:33:45.250463 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-37abbf34-c24d-4124-95aa-d9bf86b3e068 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:45.250989 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-37abbf34-c24d-4124-95aa-d9bf86b3e068 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:45.251407 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-37abbf34-c24d-4124-95aa-d9bf86b3e068 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:45.252093 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-37abbf34-c24d-4124-95aa-d9bf86b3e068 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:45.252545 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-37abbf34-c24d-4124-95aa-d9bf86b3e068 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:45.252968 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-37abbf34-c24d-4124-95aa-d9bf86b3e068 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:45.280140 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-37abbf34-c24d-4124-95aa-d9bf86b3e068 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] [instance: 81104a95-fe7a-4983-b5c5-2ad4d2463832] Going to try to terminate instance {{(pid=117837) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 14:33:45.315131 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:33:45.360349 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-37abbf34-c24d-4124-95aa-d9bf86b3e068 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] 10.222.0.17 "DELETE /compute/v2.1/servers/81104a95-fe7a-4983-b5c5-2ad4d2463832" status: 204 len: 0 microversion: 2.1 time: 0.119791 Aug 06 14:33:45.360850 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 266/514] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Aug 6 14:33:45 2022] DELETE /compute/v2.1/servers/81104a95-fe7a-4983-b5c5-2ad4d2463832 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 14:33:45.370817 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-84614c5c-ab79-465a-a8b5-a855738ec64c tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:33:45.371557 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-84614c5c-ab79-465a-a8b5-a855738ec64c tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] [instance: 81104a95-fe7a-4983-b5c5-2ad4d2463832] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:33:45.377293 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-84614c5c-ab79-465a-a8b5-a855738ec64c tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:45.377764 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-84614c5c-ab79-465a-a8b5-a855738ec64c tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:45.378193 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-84614c5c-ab79-465a-a8b5-a855738ec64c tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:45.378896 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-84614c5c-ab79-465a-a8b5-a855738ec64c tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:45.379356 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-84614c5c-ab79-465a-a8b5-a855738ec64c tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:45.379772 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-84614c5c-ab79-465a-a8b5-a855738ec64c tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:45.503156 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.virt.hardware [None req-16260354-ac24-4caf-ab01-0d1c672b8323 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Flavor limits 0:0:0 {{(pid=117838) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 14:33:45.503574 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.virt.hardware [None req-16260354-ac24-4caf-ab01-0d1c672b8323 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Image limits 0:0:0 {{(pid=117838) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 14:33:45.504070 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.virt.hardware [None req-16260354-ac24-4caf-ab01-0d1c672b8323 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Flavor pref 0:0:0 {{(pid=117838) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 14:33:45.504494 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.virt.hardware [None req-16260354-ac24-4caf-ab01-0d1c672b8323 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Image pref 0:0:0 {{(pid=117838) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 14:33:45.504954 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.virt.hardware [None req-16260354-ac24-4caf-ab01-0d1c672b8323 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117838) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 14:33:45.513026 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-84614c5c-ab79-465a-a8b5-a855738ec64c tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6f411ed91946eba54e46799edb12d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e7a9fef10f4aba994347a5d714f17f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:45.514277 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-16260354-ac24-4caf-ab01-0d1c672b8323 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:45.514775 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-16260354-ac24-4caf-ab01-0d1c672b8323 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:45.515231 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-16260354-ac24-4caf-ab01-0d1c672b8323 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:45.515969 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-16260354-ac24-4caf-ab01-0d1c672b8323 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:45.516411 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-16260354-ac24-4caf-ab01-0d1c672b8323 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:45.516831 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-16260354-ac24-4caf-ab01-0d1c672b8323 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:45.521098 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-84614c5c-ab79-465a-a8b5-a855738ec64c tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] 10.222.0.17 "GET /compute/v2.1/servers/81104a95-fe7a-4983-b5c5-2ad4d2463832" status: 200 len: 1512 microversion: 2.1 time: 0.155245 Aug 06 14:33:45.521735 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 267/515] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:33:45 2022] GET /compute/v2.1/servers/81104a95-fe7a-4983-b5c5-2ad4d2463832 => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:33:45.533715 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.quota [None req-16260354-ac24-4caf-ab01-0d1c672b8323 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Getting quotas for project 96a7bb12d3ed4d1db2a58a03472483c2. Resources: {'cores', 'instances', 'ram'} {{(pid=117838) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 14:33:45.537579 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.quota [None req-16260354-ac24-4caf-ab01-0d1c672b8323 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Getting quotas for user 5378c85cd31c42dfbc39ce738a8b6dde and project 96a7bb12d3ed4d1db2a58a03472483c2. Resources: {'cores', 'instances', 'ram'} {{(pid=117838) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 14:33:45.548269 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-16260354-ac24-4caf-ab01-0d1c672b8323 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Going to run 1 instances... {{(pid=117838) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 14:33:45.550497 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-16260354-ac24-4caf-ab01-0d1c672b8323 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 5a1c9667-a38f-471a-a735-b5dff6828a51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='13d7ee60-c9c3-43ee-9861-a9192a114a77',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117838) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 14:33:45.597866 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-16260354-ac24-4caf-ab01-0d1c672b8323 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.613976 Aug 06 14:33:45.598502 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 249/516] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Aug 6 14:33:44 2022] POST /compute/v2.1/servers => generated 401 bytes in 615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 14:33:45.609376 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-c4dec935-2e4f-45f5-89b9-3555d97eb288 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:33:45.610088 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-c4dec935-2e4f-45f5-89b9-3555d97eb288 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 5a1c9667-a38f-471a-a735-b5dff6828a51] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:33:45.662456 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-c4dec935-2e4f-45f5-89b9-3555d97eb288 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:45.669105 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-c4dec935-2e4f-45f5-89b9-3555d97eb288 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51" status: 200 len: 1241 microversion: 2.1 time: 0.063660 Aug 06 14:33:45.669664 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 268/517] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:33:45 2022] GET /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51 => generated 1241 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:33:46.262086 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-ffe63458-4296-439e-bf93-91bfc4abb3a7 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:33:46.262688 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-ffe63458-4296-439e-bf93-91bfc4abb3a7 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:33:46.269867 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ffe63458-4296-439e-bf93-91bfc4abb3a7 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:46.270352 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ffe63458-4296-439e-bf93-91bfc4abb3a7 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:46.270800 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ffe63458-4296-439e-bf93-91bfc4abb3a7 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:46.271515 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ffe63458-4296-439e-bf93-91bfc4abb3a7 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:46.272159 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ffe63458-4296-439e-bf93-91bfc4abb3a7 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:46.272617 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ffe63458-4296-439e-bf93-91bfc4abb3a7 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:46.350071 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [req-b2056f01-6a60-4004-86c4-c2537f0fe3d9 req-14b35569-706f-49ae-b0c5-422978fb5737 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cf29bae-83f8-43e3-9118-0fea5a019ff8", "name": "network-vif-plugged", "status": "completed", "tag": "988ecdda-956b-4c8b-8ee4-231ef3ed0bb2"}]} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:33:46.361774 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-b2056f01-6a60-4004-86c4-c2537f0fe3d9 req-14b35569-706f-49ae-b0c5-422978fb5737 service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:46.362391 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-b2056f01-6a60-4004-86c4-c2537f0fe3d9 req-14b35569-706f-49ae-b0c5-422978fb5737 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:46.362913 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-b2056f01-6a60-4004-86c4-c2537f0fe3d9 req-14b35569-706f-49ae-b0c5-422978fb5737 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:46.374489 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.compute.server_external_events [req-b2056f01-6a60-4004-86c4-c2537f0fe3d9 req-14b35569-706f-49ae-b0c5-422978fb5737 service nova] Creating event network-vif-plugged:988ecdda-956b-4c8b-8ee4-231ef3ed0bb2 for instance 5cf29bae-83f8-43e3-9118-0fea5a019ff8 on hv-cinder-85199 Aug 06 14:33:46.379415 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [req-b2056f01-6a60-4004-86c4-c2537f0fe3d9 req-14b35569-706f-49ae-b0c5-422978fb5737 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033163 Aug 06 14:33:46.380007 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 269/518] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:33:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 14:33:46.408893 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-ffe63458-4296-439e-bf93-91bfc4abb3a7 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:46.417672 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-ffe63458-4296-439e-bf93-91bfc4abb3a7 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:46.419212 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-ffe63458-4296-439e-bf93-91bfc4abb3a7 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:46.420389 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-ffe63458-4296-439e-bf93-91bfc4abb3a7 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1746 microversion: 2.20 time: 0.162735 Aug 06 14:33:46.420944 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 250/519] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:33:46 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1746 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:33:46.487952 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-a6cdbf6d-13a1-4b17-8883-f1b4117d0cf7 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:33:46.488450 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-a6cdbf6d-13a1-4b17-8883-f1b4117d0cf7 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:33:46.494613 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a6cdbf6d-13a1-4b17-8883-f1b4117d0cf7 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:46.495125 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a6cdbf6d-13a1-4b17-8883-f1b4117d0cf7 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:46.495559 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a6cdbf6d-13a1-4b17-8883-f1b4117d0cf7 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:46.496239 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a6cdbf6d-13a1-4b17-8883-f1b4117d0cf7 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:46.496691 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a6cdbf6d-13a1-4b17-8883-f1b4117d0cf7 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:46.497114 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a6cdbf6d-13a1-4b17-8883-f1b4117d0cf7 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:46.519460 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-a6cdbf6d-13a1-4b17-8883-f1b4117d0cf7 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac/ips" status: 200 len: 145 microversion: 2.1 time: 0.035808 Aug 06 14:33:46.520008 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 270/520] 10.222.0.17 () {58 vars in 1248 bytes} [Sat Aug 6 14:33:46 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac/ips => generated 145 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:33:46.541957 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-b3ec42d9-13dd-4cb3-96f9-47e028ca9ac2 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:33:46.542573 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-b3ec42d9-13dd-4cb3-96f9-47e028ca9ac2 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] [instance: 81104a95-fe7a-4983-b5c5-2ad4d2463832] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:33:46.548435 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b3ec42d9-13dd-4cb3-96f9-47e028ca9ac2 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:46.548925 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b3ec42d9-13dd-4cb3-96f9-47e028ca9ac2 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:46.549357 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b3ec42d9-13dd-4cb3-96f9-47e028ca9ac2 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:46.550044 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b3ec42d9-13dd-4cb3-96f9-47e028ca9ac2 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:46.550496 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b3ec42d9-13dd-4cb3-96f9-47e028ca9ac2 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:46.550947 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b3ec42d9-13dd-4cb3-96f9-47e028ca9ac2 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:46.680582 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-b3ec42d9-13dd-4cb3-96f9-47e028ca9ac2 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6f411ed91946eba54e46799edb12d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e7a9fef10f4aba994347a5d714f17f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:46.688386 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-b3ec42d9-13dd-4cb3-96f9-47e028ca9ac2 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] 10.222.0.17 "GET /compute/v2.1/servers/81104a95-fe7a-4983-b5c5-2ad4d2463832" status: 200 len: 1512 microversion: 2.1 time: 0.150837 Aug 06 14:33:46.689118 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 251/521] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:33:46 2022] GET /compute/v2.1/servers/81104a95-fe7a-4983-b5c5-2ad4d2463832 => generated 1512 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:33:46.690323 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-350918b8-c7bc-4264-9d5d-692af42b883f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:33:46.691082 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-350918b8-c7bc-4264-9d5d-692af42b883f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 5a1c9667-a38f-471a-a735-b5dff6828a51] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:33:46.697650 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-350918b8-c7bc-4264-9d5d-692af42b883f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:46.698230 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-350918b8-c7bc-4264-9d5d-692af42b883f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:46.698766 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-350918b8-c7bc-4264-9d5d-692af42b883f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:46.699578 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-350918b8-c7bc-4264-9d5d-692af42b883f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:46.700116 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-350918b8-c7bc-4264-9d5d-692af42b883f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:46.700615 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-350918b8-c7bc-4264-9d5d-692af42b883f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:46.768905 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-350918b8-c7bc-4264-9d5d-692af42b883f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:46.776965 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-350918b8-c7bc-4264-9d5d-692af42b883f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51" status: 200 len: 1245 microversion: 2.1 time: 0.091236 Aug 06 14:33:46.777521 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 271/522] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:33:46 2022] GET /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51 => generated 1245 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:33:47.443509 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-82095ce2-0821-486e-aafe-e607f3b0fe00 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:33:47.444145 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-82095ce2-0821-486e-aafe-e607f3b0fe00 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:33:47.450566 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-82095ce2-0821-486e-aafe-e607f3b0fe00 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:47.451084 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-82095ce2-0821-486e-aafe-e607f3b0fe00 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:47.451518 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-82095ce2-0821-486e-aafe-e607f3b0fe00 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:47.452202 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-82095ce2-0821-486e-aafe-e607f3b0fe00 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:47.452655 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-82095ce2-0821-486e-aafe-e607f3b0fe00 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:47.453077 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-82095ce2-0821-486e-aafe-e607f3b0fe00 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:47.470748 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:33:47.582159 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-82095ce2-0821-486e-aafe-e607f3b0fe00 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:47.590260 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-82095ce2-0821-486e-aafe-e607f3b0fe00 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:47.591791 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-82095ce2-0821-486e-aafe-e607f3b0fe00 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:47.592949 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-82095ce2-0821-486e-aafe-e607f3b0fe00 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1746 microversion: 2.20 time: 0.153388 Aug 06 14:33:47.593506 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 252/523] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:33:47 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 14:33:47.767711 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-f82690cb-c60b-4579-bc03-2e7037548df8 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:33:47.768249 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-f82690cb-c60b-4579-bc03-2e7037548df8 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] [instance: 81104a95-fe7a-4983-b5c5-2ad4d2463832] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:33:47.774634 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f82690cb-c60b-4579-bc03-2e7037548df8 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:47.775152 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f82690cb-c60b-4579-bc03-2e7037548df8 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:47.775589 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f82690cb-c60b-4579-bc03-2e7037548df8 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:47.776274 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f82690cb-c60b-4579-bc03-2e7037548df8 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:47.776730 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f82690cb-c60b-4579-bc03-2e7037548df8 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:47.777152 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f82690cb-c60b-4579-bc03-2e7037548df8 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:47.797852 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-7902dd3b-963d-4628-90e9-1b1e0dc553ea tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:33:47.798553 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-7902dd3b-963d-4628-90e9-1b1e0dc553ea tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 5a1c9667-a38f-471a-a735-b5dff6828a51] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:33:47.804770 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7902dd3b-963d-4628-90e9-1b1e0dc553ea tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:47.805252 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7902dd3b-963d-4628-90e9-1b1e0dc553ea tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:47.806457 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7902dd3b-963d-4628-90e9-1b1e0dc553ea tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:47.806977 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7902dd3b-963d-4628-90e9-1b1e0dc553ea tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:47.808698 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7902dd3b-963d-4628-90e9-1b1e0dc553ea tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:47.809158 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7902dd3b-963d-4628-90e9-1b1e0dc553ea tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:47.873785 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-7902dd3b-963d-4628-90e9-1b1e0dc553ea tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:47.881289 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-7902dd3b-963d-4628-90e9-1b1e0dc553ea tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51" status: 200 len: 1293 microversion: 2.1 time: 0.087248 Aug 06 14:33:47.881853 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 253/524] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:33:47 2022] GET /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51 => generated 1293 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:33:47.910674 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-f82690cb-c60b-4579-bc03-2e7037548df8 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6f411ed91946eba54e46799edb12d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e7a9fef10f4aba994347a5d714f17f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:47.918943 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-f82690cb-c60b-4579-bc03-2e7037548df8 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] 10.222.0.17 "GET /compute/v2.1/servers/81104a95-fe7a-4983-b5c5-2ad4d2463832" status: 200 len: 1512 microversion: 2.1 time: 0.155174 Aug 06 14:33:47.919497 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 272/525] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:33:47 2022] GET /compute/v2.1/servers/81104a95-fe7a-4983-b5c5-2ad4d2463832 => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:33:48.616087 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-edc4ae7a-57f9-4871-894a-fb342283b7fe tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:33:48.616680 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-edc4ae7a-57f9-4871-894a-fb342283b7fe tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:33:48.623827 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-edc4ae7a-57f9-4871-894a-fb342283b7fe tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:48.624301 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-edc4ae7a-57f9-4871-894a-fb342283b7fe tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:48.624730 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-edc4ae7a-57f9-4871-894a-fb342283b7fe tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:48.625578 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-edc4ae7a-57f9-4871-894a-fb342283b7fe tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:48.626029 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-edc4ae7a-57f9-4871-894a-fb342283b7fe tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:48.626620 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-edc4ae7a-57f9-4871-894a-fb342283b7fe tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:48.777257 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [req-0265d012-7c20-442d-81f7-531301c6e4c7 req-0aad366f-cf26-4284-9dc4-bb72362665fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81104a95-fe7a-4983-b5c5-2ad4d2463832", "name": "network-vif-deleted", "tag": "40e19162-8595-40db-9b52-bf0b15a595ec"}]} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:33:48.783088 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:33:48.789891 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-0265d012-7c20-442d-81f7-531301c6e4c7 req-0aad366f-cf26-4284-9dc4-bb72362665fa service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:48.790595 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-0265d012-7c20-442d-81f7-531301c6e4c7 req-0aad366f-cf26-4284-9dc4-bb72362665fa service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:48.791290 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-0265d012-7c20-442d-81f7-531301c6e4c7 req-0aad366f-cf26-4284-9dc4-bb72362665fa service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:48.804621 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.compute.server_external_events [req-0265d012-7c20-442d-81f7-531301c6e4c7 req-0aad366f-cf26-4284-9dc4-bb72362665fa service nova] Creating event network-vif-deleted:40e19162-8595-40db-9b52-bf0b15a595ec for instance 81104a95-fe7a-4983-b5c5-2ad4d2463832 on hv-cinder-85199 Aug 06 14:33:48.810405 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [req-0265d012-7c20-442d-81f7-531301c6e4c7 req-0aad366f-cf26-4284-9dc4-bb72362665fa service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037363 Aug 06 14:33:48.811533 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 273/526] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:33:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 14:33:48.866583 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-edc4ae7a-57f9-4871-894a-fb342283b7fe tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:48.876283 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-edc4ae7a-57f9-4871-894a-fb342283b7fe tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:48.878099 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-edc4ae7a-57f9-4871-894a-fb342283b7fe tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:48.879860 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-edc4ae7a-57f9-4871-894a-fb342283b7fe tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1746 microversion: 2.20 time: 0.267855 Aug 06 14:33:48.880933 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 254/527] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:33:48 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1746 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:33:48.903755 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-722e7841-26a7-40aa-8209-af57c756073b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:33:48.904509 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-722e7841-26a7-40aa-8209-af57c756073b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 5a1c9667-a38f-471a-a735-b5dff6828a51] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:33:48.915608 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-722e7841-26a7-40aa-8209-af57c756073b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:48.918169 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-722e7841-26a7-40aa-8209-af57c756073b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:48.918695 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-722e7841-26a7-40aa-8209-af57c756073b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:48.920082 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-722e7841-26a7-40aa-8209-af57c756073b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:48.920624 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-722e7841-26a7-40aa-8209-af57c756073b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:48.922243 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-722e7841-26a7-40aa-8209-af57c756073b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:48.940724 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-4a90a2f6-d090-4754-bb18-24beae7b248b tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:33:48.941429 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-4a90a2f6-d090-4754-bb18-24beae7b248b tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] [instance: 81104a95-fe7a-4983-b5c5-2ad4d2463832] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:33:48.947754 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4a90a2f6-d090-4754-bb18-24beae7b248b tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:48.948932 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4a90a2f6-d090-4754-bb18-24beae7b248b tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:48.949659 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4a90a2f6-d090-4754-bb18-24beae7b248b tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:48.950507 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4a90a2f6-d090-4754-bb18-24beae7b248b tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:48.951204 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4a90a2f6-d090-4754-bb18-24beae7b248b tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:48.951772 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4a90a2f6-d090-4754-bb18-24beae7b248b tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:49.004927 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4a90a2f6-d090-4754-bb18-24beae7b248b tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:49.005546 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4a90a2f6-d090-4754-bb18-24beae7b248b tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:49.006334 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4a90a2f6-d090-4754-bb18-24beae7b248b tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:49.007205 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.objects.instance [None req-4a90a2f6-d090-4754-bb18-24beae7b248b tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lazy-loading 'fault' on Instance uuid 81104a95-fe7a-4983-b5c5-2ad4d2463832 {{(pid=117838) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 14:33:49.025547 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-722e7841-26a7-40aa-8209-af57c756073b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:49.035955 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-722e7841-26a7-40aa-8209-af57c756073b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51" status: 200 len: 1299 microversion: 2.1 time: 0.137334 Aug 06 14:33:49.036514 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 274/528] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:33:48 2022] GET /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51 => generated 1299 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:33:49.088422 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-4a90a2f6-d090-4754-bb18-24beae7b248b tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6f411ed91946eba54e46799edb12d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e7a9fef10f4aba994347a5d714f17f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:49.096886 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-4a90a2f6-d090-4754-bb18-24beae7b248b tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] 10.222.0.17 "GET /compute/v2.1/servers/81104a95-fe7a-4983-b5c5-2ad4d2463832" status: 200 len: 1309 microversion: 2.1 time: 0.160562 Aug 06 14:33:49.097538 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 255/529] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:33:48 2022] GET /compute/v2.1/servers/81104a95-fe7a-4983-b5c5-2ad4d2463832 => generated 1309 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:33:49.901624 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-5b574c70-365c-48a5-b710-9dc2d482b67a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:33:49.902225 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-5b574c70-365c-48a5-b710-9dc2d482b67a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:33:49.908630 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-5b574c70-365c-48a5-b710-9dc2d482b67a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:49.909104 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-5b574c70-365c-48a5-b710-9dc2d482b67a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:49.909533 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-5b574c70-365c-48a5-b710-9dc2d482b67a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:49.910210 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-5b574c70-365c-48a5-b710-9dc2d482b67a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:49.910665 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-5b574c70-365c-48a5-b710-9dc2d482b67a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:49.911212 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-5b574c70-365c-48a5-b710-9dc2d482b67a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:50.043120 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-5b574c70-365c-48a5-b710-9dc2d482b67a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:50.051461 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-5b574c70-365c-48a5-b710-9dc2d482b67a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:50.053276 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-5b574c70-365c-48a5-b710-9dc2d482b67a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:50.054565 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-5b574c70-365c-48a5-b710-9dc2d482b67a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1746 microversion: 2.20 time: 0.156943 Aug 06 14:33:50.055153 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 275/530] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:33:49 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1746 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:33:50.058820 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-f2872f6d-710f-4568-ba54-8693ed1d3e56 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:33:50.059627 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-f2872f6d-710f-4568-ba54-8693ed1d3e56 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 5a1c9667-a38f-471a-a735-b5dff6828a51] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:33:50.066339 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f2872f6d-710f-4568-ba54-8693ed1d3e56 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:50.066820 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f2872f6d-710f-4568-ba54-8693ed1d3e56 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:50.067337 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f2872f6d-710f-4568-ba54-8693ed1d3e56 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:50.068025 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f2872f6d-710f-4568-ba54-8693ed1d3e56 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:50.068501 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f2872f6d-710f-4568-ba54-8693ed1d3e56 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:50.069111 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f2872f6d-710f-4568-ba54-8693ed1d3e56 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:50.116658 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-0da7b687-95d0-48ed-8827-a6142e7a5cd1 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:33:50.117623 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-0da7b687-95d0-48ed-8827-a6142e7a5cd1 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] [instance: 81104a95-fe7a-4983-b5c5-2ad4d2463832] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:33:50.124010 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0da7b687-95d0-48ed-8827-a6142e7a5cd1 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:50.124485 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0da7b687-95d0-48ed-8827-a6142e7a5cd1 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:50.124907 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0da7b687-95d0-48ed-8827-a6142e7a5cd1 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:50.125585 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0da7b687-95d0-48ed-8827-a6142e7a5cd1 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:50.126027 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0da7b687-95d0-48ed-8827-a6142e7a5cd1 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:50.126438 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0da7b687-95d0-48ed-8827-a6142e7a5cd1 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:50.139803 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.wsgi [None req-0da7b687-95d0-48ed-8827-a6142e7a5cd1 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] HTTP exception thrown: Instance 81104a95-fe7a-4983-b5c5-2ad4d2463832 could not be found. Aug 06 14:33:50.141492 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-0da7b687-95d0-48ed-8827-a6142e7a5cd1 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Request method failure captured: Aug 06 14:33:50.141492 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: request: GET /compute/v2.1/servers/81104a95-fe7a-4983-b5c5-2ad4d2463832 HTTP/1.1 Aug 06 14:33:50.141492 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Accept: application/json Aug 06 14:33:50.141492 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Accept-Encoding: identity Aug 06 14:33:50.141492 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Connection: close Aug 06 14:33:50.141492 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Content-Length: 0 Aug 06 14:33:50.141492 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Content-Type: application/json Aug 06 14:33:50.141492 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Host: 10.222.0.17 Aug 06 14:33:50.141492 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Openstack-System-Scope: None Aug 06 14:33:50.141492 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: User-Agent: python-urllib3/1.26.11 Aug 06 14:33:50.141492 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Auth-Token: gAAAAABi7ntHfybhdLqD_MfQ5VIlrZZ2gnWk4LJDCQL1qmT9tDp7MeKkqfM-l89NZRj-buc66p-KyuWHFHQw7Zxxa6JW05QABm75MyL0fAyEtuFx3M5aSgeE7loE4Y6TyRy4L5jhVvtaGt6G_UlZWRwZPkkoG0ACuW2oMXwRTkQbTyaDpf_6CM4 Aug 06 14:33:50.141492 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Domain-Id: None Aug 06 14:33:50.141492 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Domain-Name: None Aug 06 14:33:50.141492 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Identity-Status: Confirmed Aug 06 14:33:50.141492 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Is-Admin-Project: True Aug 06 14:33:50.141492 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Domain-Id: default Aug 06 14:33:50.141492 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Domain-Name: Default Aug 06 14:33:50.141492 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Id: 59e7a9fef10f4aba994347a5d714f17f Aug 06 14:33:50.141492 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1131716616 Aug 06 14:33:50.141492 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Role: member,reader Aug 06 14:33:50.141492 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Roles: member,reader Aug 06 14:33:50.142842 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/59e7a9fef10f4aba994347a5d714f17f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/59e7a9fef10f4aba994347a5d714f17f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_59e7a9fef10f4aba994347a5d714f17f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/59e7a9fef10f4aba994347a5d714f17f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 06 14:33:50.142842 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant: tempest-VolumesSnapshotTestJSON-1131716616 Aug 06 14:33:50.142842 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant-Id: 59e7a9fef10f4aba994347a5d714f17f Aug 06 14:33:50.142842 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1131716616 Aug 06 14:33:50.142842 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User: tempest-VolumesSnapshotTestJSON-1131716616-project Aug 06 14:33:50.142842 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Domain-Id: default Aug 06 14:33:50.142842 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Domain-Name: Default Aug 06 14:33:50.142842 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Id: eb6f411ed91946eba54e46799edb12d3 Aug 06 14:33:50.142842 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Name: tempest-VolumesSnapshotTestJSON-1131716616-project Aug 06 14:33:50.142842 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: method: > Aug 06 14:33:50.142842 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: exception: Instance 81104a95-fe7a-4983-b5c5-2ad4d2463832 could not be found. Aug 06 14:33:50.142842 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: action_args: {'id': '81104a95-fe7a-4983-b5c5-2ad4d2463832'} Aug 06 14:33:50.143633 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 14:33:50.143633 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:33:50.143633 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 14:33:50.143633 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 14:33:50.143633 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 14:33:50.143633 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 14:33:50.143633 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 14:33:50.143633 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 14:33:50.143633 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 14:33:50.143633 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 14:33:50.143633 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81104a95-fe7a-4983-b5c5-2ad4d2463832 could not be found. Aug 06 14:33:50.143633 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:33:50.143633 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:33:50.143633 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:33:50.143633 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:33:50.143633 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:33:50.143633 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:33:50.143633 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 14:33:50.143633 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 14:33:50.143633 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 14:33:50.145227 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 14:33:50.145227 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 14:33:50.145227 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 14:33:50.145227 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 14:33:50.145227 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 14:33:50.145227 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 14:33:50.145227 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 14:33:50.145227 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81104a95-fe7a-4983-b5c5-2ad4d2463832 could not be found. Aug 06 14:33:50.145227 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:33:50.145227 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:33:50.145227 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:33:50.145227 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:33:50.145227 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:33:50.145227 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:33:50.145227 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 14:33:50.145227 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 14:33:50.145227 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81104a95-fe7a-4983-b5c5-2ad4d2463832 could not be found. Aug 06 14:33:50.145227 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:33:50.146281 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-0da7b687-95d0-48ed-8827-a6142e7a5cd1 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Returning 404 to user: Instance 81104a95-fe7a-4983-b5c5-2ad4d2463832 could not be found. {{(pid=117837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 14:33:50.146281 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-0da7b687-95d0-48ed-8827-a6142e7a5cd1 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] 10.222.0.17 "GET /compute/v2.1/servers/81104a95-fe7a-4983-b5c5-2ad4d2463832" status: 404 len: 111 microversion: 2.1 time: 0.030165 Aug 06 14:33:50.146281 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 276/531] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:33:50 2022] GET /compute/v2.1/servers/81104a95-fe7a-4983-b5c5-2ad4d2463832 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 06 14:33:50.199030 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [req-c5d77579-ed88-48c1-b218-0068dec4148f req-726efe8d-8b5f-4425-8501-bb15be630992 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a1c9667-a38f-471a-a735-b5dff6828a51", "tag": "68b8be56-ac5e-4c38-886e-400dc8b14354"}]} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:33:50.208795 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-c5d77579-ed88-48c1-b218-0068dec4148f req-726efe8d-8b5f-4425-8501-bb15be630992 service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:50.209246 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-c5d77579-ed88-48c1-b218-0068dec4148f req-726efe8d-8b5f-4425-8501-bb15be630992 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:50.209878 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-c5d77579-ed88-48c1-b218-0068dec4148f req-726efe8d-8b5f-4425-8501-bb15be630992 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:50.226002 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.compute.server_external_events [req-c5d77579-ed88-48c1-b218-0068dec4148f req-726efe8d-8b5f-4425-8501-bb15be630992 service nova] Creating event network-changed:68b8be56-ac5e-4c38-886e-400dc8b14354 for instance 5a1c9667-a38f-471a-a735-b5dff6828a51 on hv-cinder-85199 Aug 06 14:33:50.232429 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [req-c5d77579-ed88-48c1-b218-0068dec4148f req-726efe8d-8b5f-4425-8501-bb15be630992 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039109 Aug 06 14:33:50.234129 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 277/532] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:33:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 14:33:50.287991 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-f2872f6d-710f-4568-ba54-8693ed1d3e56 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:50.297164 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-f2872f6d-710f-4568-ba54-8693ed1d3e56 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51" status: 200 len: 1366 microversion: 2.1 time: 0.243347 Aug 06 14:33:50.297703 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 256/533] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:33:50 2022] GET /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51 => generated 1366 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:33:51.079770 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-17af2c1d-2fef-4281-bb47-2d4d8dab03b5 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:33:51.080412 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-17af2c1d-2fef-4281-bb47-2d4d8dab03b5 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:33:51.087137 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-17af2c1d-2fef-4281-bb47-2d4d8dab03b5 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:51.087614 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-17af2c1d-2fef-4281-bb47-2d4d8dab03b5 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:51.088042 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-17af2c1d-2fef-4281-bb47-2d4d8dab03b5 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:51.088810 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-17af2c1d-2fef-4281-bb47-2d4d8dab03b5 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:51.089265 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-17af2c1d-2fef-4281-bb47-2d4d8dab03b5 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:51.089683 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-17af2c1d-2fef-4281-bb47-2d4d8dab03b5 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:51.226763 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-17af2c1d-2fef-4281-bb47-2d4d8dab03b5 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:51.237022 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-17af2c1d-2fef-4281-bb47-2d4d8dab03b5 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:51.238922 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-17af2c1d-2fef-4281-bb47-2d4d8dab03b5 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:51.242099 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-17af2c1d-2fef-4281-bb47-2d4d8dab03b5 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1746 microversion: 2.20 time: 0.166807 Aug 06 14:33:51.242781 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 278/534] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:33:51 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1746 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:33:51.276003 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-db4d05ad-b6bb-4fef-904c-294b18216d95 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "48ecd1ac-4d0b-4687-a221-e2423b6a8005"}} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:33:51.278420 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-db4d05ad-b6bb-4fef-904c-294b18216d95 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:33:51.285038 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-db4d05ad-b6bb-4fef-904c-294b18216d95 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:51.285517 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-db4d05ad-b6bb-4fef-904c-294b18216d95 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:51.285978 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-db4d05ad-b6bb-4fef-904c-294b18216d95 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:51.286655 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-db4d05ad-b6bb-4fef-904c-294b18216d95 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:51.287126 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-db4d05ad-b6bb-4fef-904c-294b18216d95 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:51.287551 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-db4d05ad-b6bb-4fef-904c-294b18216d95 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:51.319034 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-d15d40d2-c58f-45a1-92d1-a85b722fb29c tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:33:51.319642 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-d15d40d2-c58f-45a1-92d1-a85b722fb29c tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 5a1c9667-a38f-471a-a735-b5dff6828a51] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:33:51.327011 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d15d40d2-c58f-45a1-92d1-a85b722fb29c tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:51.327496 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d15d40d2-c58f-45a1-92d1-a85b722fb29c tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:51.327930 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d15d40d2-c58f-45a1-92d1-a85b722fb29c tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:51.328618 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d15d40d2-c58f-45a1-92d1-a85b722fb29c tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:51.329237 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d15d40d2-c58f-45a1-92d1-a85b722fb29c tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:51.329659 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d15d40d2-c58f-45a1-92d1-a85b722fb29c tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:51.457685 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-d15d40d2-c58f-45a1-92d1-a85b722fb29c tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:51.464944 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-d15d40d2-c58f-45a1-92d1-a85b722fb29c tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51" status: 200 len: 1366 microversion: 2.1 time: 0.149900 Aug 06 14:33:51.465494 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 279/535] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:33:51 2022] GET /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:33:52.266693 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-7e8b10a1-704a-42d8-947a-b28c6aba4b54 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:33:52.267416 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-7e8b10a1-704a-42d8-947a-b28c6aba4b54 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:33:52.273617 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7e8b10a1-704a-42d8-947a-b28c6aba4b54 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:52.274096 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7e8b10a1-704a-42d8-947a-b28c6aba4b54 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:52.274531 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7e8b10a1-704a-42d8-947a-b28c6aba4b54 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:52.275244 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7e8b10a1-704a-42d8-947a-b28c6aba4b54 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:52.275701 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7e8b10a1-704a-42d8-947a-b28c6aba4b54 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:52.276810 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7e8b10a1-704a-42d8-947a-b28c6aba4b54 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:52.405301 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-7e8b10a1-704a-42d8-947a-b28c6aba4b54 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:52.413292 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-7e8b10a1-704a-42d8-947a-b28c6aba4b54 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:52.414779 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-7e8b10a1-704a-42d8-947a-b28c6aba4b54 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:52.415946 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-7e8b10a1-704a-42d8-947a-b28c6aba4b54 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1746 microversion: 2.20 time: 0.153172 Aug 06 14:33:52.416475 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 280/536] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:33:52 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 14:33:52.487470 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-c4e8c22e-95dc-4843-9f51-bae7c0887b55 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:33:52.488068 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-c4e8c22e-95dc-4843-9f51-bae7c0887b55 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 5a1c9667-a38f-471a-a735-b5dff6828a51] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:33:52.493967 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c4e8c22e-95dc-4843-9f51-bae7c0887b55 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:52.494479 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c4e8c22e-95dc-4843-9f51-bae7c0887b55 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:52.495663 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c4e8c22e-95dc-4843-9f51-bae7c0887b55 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:52.496356 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c4e8c22e-95dc-4843-9f51-bae7c0887b55 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:52.496811 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c4e8c22e-95dc-4843-9f51-bae7c0887b55 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:52.497235 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c4e8c22e-95dc-4843-9f51-bae7c0887b55 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:52.624057 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-c4e8c22e-95dc-4843-9f51-bae7c0887b55 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:52.631404 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-c4e8c22e-95dc-4843-9f51-bae7c0887b55 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51" status: 200 len: 1366 microversion: 2.1 time: 0.150152 Aug 06 14:33:52.631950 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 281/537] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:33:52 2022] GET /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:33:53.437601 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-640b519f-3b3c-4ab8-bc7d-bc576c97e3cd tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:33:53.438233 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-640b519f-3b3c-4ab8-bc7d-bc576c97e3cd tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:33:53.444528 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-640b519f-3b3c-4ab8-bc7d-bc576c97e3cd tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:53.445121 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-640b519f-3b3c-4ab8-bc7d-bc576c97e3cd tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:53.445415 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-640b519f-3b3c-4ab8-bc7d-bc576c97e3cd tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:53.446171 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-640b519f-3b3c-4ab8-bc7d-bc576c97e3cd tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:53.446778 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-640b519f-3b3c-4ab8-bc7d-bc576c97e3cd tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:53.447223 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-640b519f-3b3c-4ab8-bc7d-bc576c97e3cd tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:53.572604 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-640b519f-3b3c-4ab8-bc7d-bc576c97e3cd tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:53.580981 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-640b519f-3b3c-4ab8-bc7d-bc576c97e3cd tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:53.582462 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-640b519f-3b3c-4ab8-bc7d-bc576c97e3cd tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:53.583632 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-640b519f-3b3c-4ab8-bc7d-bc576c97e3cd tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1746 microversion: 2.20 time: 0.149816 Aug 06 14:33:53.584175 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 282/538] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:33:53 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1746 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 14:33:53.652597 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-78b2d594-3d98-4138-81c3-c7ccb16f5eed tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:33:53.653203 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-78b2d594-3d98-4138-81c3-c7ccb16f5eed tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 5a1c9667-a38f-471a-a735-b5dff6828a51] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:33:53.659022 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-78b2d594-3d98-4138-81c3-c7ccb16f5eed tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:53.659498 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-78b2d594-3d98-4138-81c3-c7ccb16f5eed tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:53.659926 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-78b2d594-3d98-4138-81c3-c7ccb16f5eed tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:53.660603 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-78b2d594-3d98-4138-81c3-c7ccb16f5eed tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:53.661064 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-78b2d594-3d98-4138-81c3-c7ccb16f5eed tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:53.661485 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-78b2d594-3d98-4138-81c3-c7ccb16f5eed tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:53.789315 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-78b2d594-3d98-4138-81c3-c7ccb16f5eed tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:53.796656 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-78b2d594-3d98-4138-81c3-c7ccb16f5eed tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51" status: 200 len: 1366 microversion: 2.1 time: 0.148310 Aug 06 14:33:53.797236 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 283/539] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:33:53 2022] GET /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:33:54.606913 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-367127ef-f2ff-4c6f-a336-bc82067f4dfb tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:33:54.607571 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-367127ef-f2ff-4c6f-a336-bc82067f4dfb tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:33:54.613816 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-367127ef-f2ff-4c6f-a336-bc82067f4dfb tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:54.614288 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-367127ef-f2ff-4c6f-a336-bc82067f4dfb tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:54.614710 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-367127ef-f2ff-4c6f-a336-bc82067f4dfb tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:54.615411 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-367127ef-f2ff-4c6f-a336-bc82067f4dfb tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:54.615861 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-367127ef-f2ff-4c6f-a336-bc82067f4dfb tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:54.616282 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-367127ef-f2ff-4c6f-a336-bc82067f4dfb tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:54.745486 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-367127ef-f2ff-4c6f-a336-bc82067f4dfb tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:54.753286 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-367127ef-f2ff-4c6f-a336-bc82067f4dfb tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:54.754965 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-367127ef-f2ff-4c6f-a336-bc82067f4dfb tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:54.756131 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-367127ef-f2ff-4c6f-a336-bc82067f4dfb tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1746 microversion: 2.20 time: 0.153184 Aug 06 14:33:54.756674 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 284/540] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:33:54 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 14:33:54.819187 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-2b0dcb44-0775-45a6-a7b3-85c7b806318a tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:33:54.820346 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-2b0dcb44-0775-45a6-a7b3-85c7b806318a tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 5a1c9667-a38f-471a-a735-b5dff6828a51] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:33:54.828282 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2b0dcb44-0775-45a6-a7b3-85c7b806318a tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:54.828759 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2b0dcb44-0775-45a6-a7b3-85c7b806318a tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:54.829185 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2b0dcb44-0775-45a6-a7b3-85c7b806318a tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:54.829861 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2b0dcb44-0775-45a6-a7b3-85c7b806318a tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:54.830309 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2b0dcb44-0775-45a6-a7b3-85c7b806318a tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:54.830720 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2b0dcb44-0775-45a6-a7b3-85c7b806318a tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:54.968329 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-2b0dcb44-0775-45a6-a7b3-85c7b806318a tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:54.976275 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-2b0dcb44-0775-45a6-a7b3-85c7b806318a tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51" status: 200 len: 1366 microversion: 2.1 time: 0.162024 Aug 06 14:33:54.976827 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 285/541] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:33:54 2022] GET /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:33:55.524801 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_cell0:SELECT=2 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:33:55.543842 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_cell0:SELECT=10 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:33:55.780063 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-e9389c42-f4e5-4f0f-a7be-a1862b53a088 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:33:55.780622 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-e9389c42-f4e5-4f0f-a7be-a1862b53a088 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:33:55.783108 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_cell0:SELECT=2 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:33:55.788349 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e9389c42-f4e5-4f0f-a7be-a1862b53a088 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:55.788822 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e9389c42-f4e5-4f0f-a7be-a1862b53a088 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:55.789251 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e9389c42-f4e5-4f0f-a7be-a1862b53a088 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:55.789933 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e9389c42-f4e5-4f0f-a7be-a1862b53a088 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:55.790380 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e9389c42-f4e5-4f0f-a7be-a1862b53a088 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:55.790796 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e9389c42-f4e5-4f0f-a7be-a1862b53a088 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:55.919916 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-e9389c42-f4e5-4f0f-a7be-a1862b53a088 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:55.923355 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:33:55.928714 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-e9389c42-f4e5-4f0f-a7be-a1862b53a088 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:55.930221 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-e9389c42-f4e5-4f0f-a7be-a1862b53a088 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:55.931671 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-e9389c42-f4e5-4f0f-a7be-a1862b53a088 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1746 microversion: 2.20 time: 0.155968 Aug 06 14:33:55.932221 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 286/542] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:33:55 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1746 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 14:33:55.997252 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-26777a00-100d-4c35-9db5-3d8cbe8a55c6 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:33:55.997855 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-26777a00-100d-4c35-9db5-3d8cbe8a55c6 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 5a1c9667-a38f-471a-a735-b5dff6828a51] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:33:56.004714 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-26777a00-100d-4c35-9db5-3d8cbe8a55c6 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:56.005196 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-26777a00-100d-4c35-9db5-3d8cbe8a55c6 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:56.005645 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-26777a00-100d-4c35-9db5-3d8cbe8a55c6 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:56.006321 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-26777a00-100d-4c35-9db5-3d8cbe8a55c6 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:56.006769 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-26777a00-100d-4c35-9db5-3d8cbe8a55c6 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:56.007230 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-26777a00-100d-4c35-9db5-3d8cbe8a55c6 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:56.139152 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-26777a00-100d-4c35-9db5-3d8cbe8a55c6 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:56.146784 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-26777a00-100d-4c35-9db5-3d8cbe8a55c6 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51" status: 200 len: 1366 microversion: 2.1 time: 0.153266 Aug 06 14:33:56.147228 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 287/543] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:33:55 2022] GET /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:33:56.957169 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-691e383b-4acc-4f9d-93d4-99c42ad80804 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:33:56.957772 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-691e383b-4acc-4f9d-93d4-99c42ad80804 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:33:56.964698 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-691e383b-4acc-4f9d-93d4-99c42ad80804 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:56.965172 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-691e383b-4acc-4f9d-93d4-99c42ad80804 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:56.965605 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-691e383b-4acc-4f9d-93d4-99c42ad80804 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:56.966286 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-691e383b-4acc-4f9d-93d4-99c42ad80804 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:56.966736 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-691e383b-4acc-4f9d-93d4-99c42ad80804 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:56.967184 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-691e383b-4acc-4f9d-93d4-99c42ad80804 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:57.100930 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-691e383b-4acc-4f9d-93d4-99c42ad80804 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:57.110196 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-691e383b-4acc-4f9d-93d4-99c42ad80804 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:57.111746 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-691e383b-4acc-4f9d-93d4-99c42ad80804 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:57.112888 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-691e383b-4acc-4f9d-93d4-99c42ad80804 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1746 microversion: 2.20 time: 0.159619 Aug 06 14:33:57.113450 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 288/544] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:33:56 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1746 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 14:33:57.166267 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-b4691e87-ca29-4b39-99d2-a74bfa3a03d3 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:33:57.167439 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-b4691e87-ca29-4b39-99d2-a74bfa3a03d3 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 5a1c9667-a38f-471a-a735-b5dff6828a51] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:33:57.173598 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b4691e87-ca29-4b39-99d2-a74bfa3a03d3 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:57.174078 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b4691e87-ca29-4b39-99d2-a74bfa3a03d3 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:57.174498 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b4691e87-ca29-4b39-99d2-a74bfa3a03d3 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:57.175317 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b4691e87-ca29-4b39-99d2-a74bfa3a03d3 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:57.175762 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b4691e87-ca29-4b39-99d2-a74bfa3a03d3 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:57.176177 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b4691e87-ca29-4b39-99d2-a74bfa3a03d3 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:57.302368 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-b4691e87-ca29-4b39-99d2-a74bfa3a03d3 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:57.309958 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-b4691e87-ca29-4b39-99d2-a74bfa3a03d3 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51" status: 200 len: 1366 microversion: 2.1 time: 0.147297 Aug 06 14:33:57.310504 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 289/545] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:33:57 2022] GET /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:33:58.135456 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-f8201f10-c3c1-4757-8a3d-e180545cee22 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:33:58.136117 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-f8201f10-c3c1-4757-8a3d-e180545cee22 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:33:58.142451 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f8201f10-c3c1-4757-8a3d-e180545cee22 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:58.142955 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f8201f10-c3c1-4757-8a3d-e180545cee22 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:58.143384 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f8201f10-c3c1-4757-8a3d-e180545cee22 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:58.144057 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f8201f10-c3c1-4757-8a3d-e180545cee22 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:58.144503 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f8201f10-c3c1-4757-8a3d-e180545cee22 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:58.144919 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f8201f10-c3c1-4757-8a3d-e180545cee22 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:58.280101 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-f8201f10-c3c1-4757-8a3d-e180545cee22 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:58.287937 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-f8201f10-c3c1-4757-8a3d-e180545cee22 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:58.289434 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-f8201f10-c3c1-4757-8a3d-e180545cee22 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:58.290580 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-f8201f10-c3c1-4757-8a3d-e180545cee22 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1746 microversion: 2.20 time: 0.159074 Aug 06 14:33:58.291166 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 290/546] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:33:58 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1746 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 14:33:58.329123 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-e4a5e6a8-287f-4497-bc71-57580918d548 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:33:58.329725 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-e4a5e6a8-287f-4497-bc71-57580918d548 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 5a1c9667-a38f-471a-a735-b5dff6828a51] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:33:58.335533 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e4a5e6a8-287f-4497-bc71-57580918d548 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:58.336008 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e4a5e6a8-287f-4497-bc71-57580918d548 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:58.336434 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e4a5e6a8-287f-4497-bc71-57580918d548 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:58.337112 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e4a5e6a8-287f-4497-bc71-57580918d548 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:58.337557 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e4a5e6a8-287f-4497-bc71-57580918d548 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:58.337980 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e4a5e6a8-287f-4497-bc71-57580918d548 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:58.463767 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-e4a5e6a8-287f-4497-bc71-57580918d548 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:58.471118 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-e4a5e6a8-287f-4497-bc71-57580918d548 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51" status: 200 len: 1366 microversion: 2.1 time: 0.145576 Aug 06 14:33:58.471674 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 291/547] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:33:58 2022] GET /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51 => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:33:59.314040 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-fda5fc51-d4d2-4e45-99bd-437bb254c896 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:33:59.314649 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-fda5fc51-d4d2-4e45-99bd-437bb254c896 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:33:59.321014 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-fda5fc51-d4d2-4e45-99bd-437bb254c896 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:59.321541 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-fda5fc51-d4d2-4e45-99bd-437bb254c896 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:59.321961 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-fda5fc51-d4d2-4e45-99bd-437bb254c896 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:59.322638 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-fda5fc51-d4d2-4e45-99bd-437bb254c896 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:59.323742 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-fda5fc51-d4d2-4e45-99bd-437bb254c896 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:59.324205 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-fda5fc51-d4d2-4e45-99bd-437bb254c896 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:59.461648 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-fda5fc51-d4d2-4e45-99bd-437bb254c896 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:59.469472 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-fda5fc51-d4d2-4e45-99bd-437bb254c896 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:59.471001 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-fda5fc51-d4d2-4e45-99bd-437bb254c896 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:59.472149 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-fda5fc51-d4d2-4e45-99bd-437bb254c896 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1746 microversion: 2.20 time: 0.161997 Aug 06 14:33:59.472701 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 292/548] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:33:59 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1746 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 14:33:59.491548 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-2ecbd379-d322-467d-b04a-bd3dd2a6b1c9 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:33:59.492145 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-2ecbd379-d322-467d-b04a-bd3dd2a6b1c9 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 5a1c9667-a38f-471a-a735-b5dff6828a51] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:33:59.498368 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2ecbd379-d322-467d-b04a-bd3dd2a6b1c9 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:59.498847 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2ecbd379-d322-467d-b04a-bd3dd2a6b1c9 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:59.499315 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2ecbd379-d322-467d-b04a-bd3dd2a6b1c9 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:59.499990 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2ecbd379-d322-467d-b04a-bd3dd2a6b1c9 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:33:59.500444 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2ecbd379-d322-467d-b04a-bd3dd2a6b1c9 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:33:59.500860 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2ecbd379-d322-467d-b04a-bd3dd2a6b1c9 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:33:59.626338 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-2ecbd379-d322-467d-b04a-bd3dd2a6b1c9 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:33:59.633651 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-2ecbd379-d322-467d-b04a-bd3dd2a6b1c9 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51" status: 200 len: 1366 microversion: 2.1 time: 0.145654 Aug 06 14:33:59.634213 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 293/549] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:33:59 2022] GET /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51 => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:34:00.495936 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-cafa43b7-b808-4d59-91a0-b95e3fc84eb8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:00.496554 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-cafa43b7-b808-4d59-91a0-b95e3fc84eb8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:00.502783 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-cafa43b7-b808-4d59-91a0-b95e3fc84eb8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:00.503287 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-cafa43b7-b808-4d59-91a0-b95e3fc84eb8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:00.503714 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-cafa43b7-b808-4d59-91a0-b95e3fc84eb8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:00.504385 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-cafa43b7-b808-4d59-91a0-b95e3fc84eb8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:00.504828 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-cafa43b7-b808-4d59-91a0-b95e3fc84eb8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:00.505240 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-cafa43b7-b808-4d59-91a0-b95e3fc84eb8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:00.631967 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-cafa43b7-b808-4d59-91a0-b95e3fc84eb8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:00.640344 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-cafa43b7-b808-4d59-91a0-b95e3fc84eb8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:00.641863 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-cafa43b7-b808-4d59-91a0-b95e3fc84eb8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:00.642989 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-cafa43b7-b808-4d59-91a0-b95e3fc84eb8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1746 microversion: 2.20 time: 0.151169 Aug 06 14:34:00.643540 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 294/550] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:34:00 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1746 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:34:00.652920 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-90ee6e71-4098-43e8-be0d-2b5a982d4cbb tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:00.653510 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-90ee6e71-4098-43e8-be0d-2b5a982d4cbb tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 5a1c9667-a38f-471a-a735-b5dff6828a51] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:00.659105 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-90ee6e71-4098-43e8-be0d-2b5a982d4cbb tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:00.659573 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-90ee6e71-4098-43e8-be0d-2b5a982d4cbb tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:00.659995 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-90ee6e71-4098-43e8-be0d-2b5a982d4cbb tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:00.660664 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-90ee6e71-4098-43e8-be0d-2b5a982d4cbb tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:00.661108 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-90ee6e71-4098-43e8-be0d-2b5a982d4cbb tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:00.661538 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-90ee6e71-4098-43e8-be0d-2b5a982d4cbb tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:00.789667 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-90ee6e71-4098-43e8-be0d-2b5a982d4cbb tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:00.797006 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-90ee6e71-4098-43e8-be0d-2b5a982d4cbb tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51" status: 200 len: 1366 microversion: 2.1 time: 0.147542 Aug 06 14:34:00.797559 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 295/551] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:34:00 2022] GET /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:34:01.283047 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=4 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:34:01.362067 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_cell1:SELECT=34 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:34:01.665828 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-fedb7973-e297-41bc-8d47-d806201d2933 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:01.667067 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-fedb7973-e297-41bc-8d47-d806201d2933 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:01.673542 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-fedb7973-e297-41bc-8d47-d806201d2933 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:01.674018 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-fedb7973-e297-41bc-8d47-d806201d2933 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:01.674444 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-fedb7973-e297-41bc-8d47-d806201d2933 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:01.675144 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-fedb7973-e297-41bc-8d47-d806201d2933 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:01.675592 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-fedb7973-e297-41bc-8d47-d806201d2933 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:01.676011 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-fedb7973-e297-41bc-8d47-d806201d2933 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:01.812510 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-fedb7973-e297-41bc-8d47-d806201d2933 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:01.820385 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-fedb7973-e297-41bc-8d47-d806201d2933 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:01.821918 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-fedb7973-e297-41bc-8d47-d806201d2933 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:01.823758 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-fedb7973-e297-41bc-8d47-d806201d2933 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1746 microversion: 2.20 time: 0.161808 Aug 06 14:34:01.824309 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 296/552] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:34:01 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1746 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 14:34:01.828775 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-fc1b3347-5d0e-42fd-8ad9-a64cc7d95c57 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:01.829373 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-fc1b3347-5d0e-42fd-8ad9-a64cc7d95c57 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 5a1c9667-a38f-471a-a735-b5dff6828a51] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:01.834951 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-fc1b3347-5d0e-42fd-8ad9-a64cc7d95c57 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:01.835428 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-fc1b3347-5d0e-42fd-8ad9-a64cc7d95c57 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:01.835856 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-fc1b3347-5d0e-42fd-8ad9-a64cc7d95c57 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:01.836545 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-fc1b3347-5d0e-42fd-8ad9-a64cc7d95c57 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:01.836997 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-fc1b3347-5d0e-42fd-8ad9-a64cc7d95c57 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:01.837419 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-fc1b3347-5d0e-42fd-8ad9-a64cc7d95c57 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:01.976360 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-fc1b3347-5d0e-42fd-8ad9-a64cc7d95c57 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:01.984119 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-fc1b3347-5d0e-42fd-8ad9-a64cc7d95c57 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51" status: 200 len: 1366 microversion: 2.1 time: 0.158735 Aug 06 14:34:01.984958 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 297/553] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:34:01 2022] GET /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:34:02.847596 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-6798c761-037c-468e-a30c-b2c37a0812b1 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:02.849389 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-6798c761-037c-468e-a30c-b2c37a0812b1 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:02.857414 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6798c761-037c-468e-a30c-b2c37a0812b1 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:02.857906 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6798c761-037c-468e-a30c-b2c37a0812b1 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:02.858343 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6798c761-037c-468e-a30c-b2c37a0812b1 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:02.859068 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6798c761-037c-468e-a30c-b2c37a0812b1 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:02.859523 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6798c761-037c-468e-a30c-b2c37a0812b1 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:02.859948 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6798c761-037c-468e-a30c-b2c37a0812b1 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:03.020494 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-6798c761-037c-468e-a30c-b2c37a0812b1 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:03.028962 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-6798c761-037c-468e-a30c-b2c37a0812b1 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:03.030468 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-6798c761-037c-468e-a30c-b2c37a0812b1 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:03.031656 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-6798c761-037c-468e-a30c-b2c37a0812b1 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1746 microversion: 2.20 time: 0.188601 Aug 06 14:34:03.032208 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 298/554] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:34:02 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1746 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:34:03.036719 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-23a0ff59-c0c7-4d3b-9faf-b0c851c8174f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:03.037326 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-23a0ff59-c0c7-4d3b-9faf-b0c851c8174f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 5a1c9667-a38f-471a-a735-b5dff6828a51] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:03.043411 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-23a0ff59-c0c7-4d3b-9faf-b0c851c8174f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:03.043890 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-23a0ff59-c0c7-4d3b-9faf-b0c851c8174f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:03.044328 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-23a0ff59-c0c7-4d3b-9faf-b0c851c8174f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:03.045005 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-23a0ff59-c0c7-4d3b-9faf-b0c851c8174f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:03.045459 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-23a0ff59-c0c7-4d3b-9faf-b0c851c8174f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:03.046056 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-23a0ff59-c0c7-4d3b-9faf-b0c851c8174f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:03.177356 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-23a0ff59-c0c7-4d3b-9faf-b0c851c8174f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:03.185110 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-23a0ff59-c0c7-4d3b-9faf-b0c851c8174f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51" status: 200 len: 1366 microversion: 2.1 time: 0.151835 Aug 06 14:34:03.185606 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 299/555] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:34:03 2022] GET /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:34:04.055591 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-6afb83b6-cc09-4402-8af3-041331ece380 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:04.056460 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-6afb83b6-cc09-4402-8af3-041331ece380 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:04.063347 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6afb83b6-cc09-4402-8af3-041331ece380 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:04.063866 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6afb83b6-cc09-4402-8af3-041331ece380 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:04.064342 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6afb83b6-cc09-4402-8af3-041331ece380 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:04.064971 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6afb83b6-cc09-4402-8af3-041331ece380 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:04.065417 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6afb83b6-cc09-4402-8af3-041331ece380 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:04.065835 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6afb83b6-cc09-4402-8af3-041331ece380 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:04.195188 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-6afb83b6-cc09-4402-8af3-041331ece380 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:04.203108 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-6afb83b6-cc09-4402-8af3-041331ece380 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:04.204588 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-6afb83b6-cc09-4402-8af3-041331ece380 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:04.205733 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-6afb83b6-cc09-4402-8af3-041331ece380 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1746 microversion: 2.20 time: 0.154007 Aug 06 14:34:04.206270 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 300/556] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:34:04 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 14:34:04.210621 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-5e99f891-0f3f-4f19-8813-616d13d34d6e tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:04.211232 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-5e99f891-0f3f-4f19-8813-616d13d34d6e tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 5a1c9667-a38f-471a-a735-b5dff6828a51] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:04.216661 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-5e99f891-0f3f-4f19-8813-616d13d34d6e tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:04.217130 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-5e99f891-0f3f-4f19-8813-616d13d34d6e tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:04.217557 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-5e99f891-0f3f-4f19-8813-616d13d34d6e tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:04.218228 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-5e99f891-0f3f-4f19-8813-616d13d34d6e tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:04.218677 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-5e99f891-0f3f-4f19-8813-616d13d34d6e tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:04.219119 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-5e99f891-0f3f-4f19-8813-616d13d34d6e tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:04.348293 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-5e99f891-0f3f-4f19-8813-616d13d34d6e tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:04.355710 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-5e99f891-0f3f-4f19-8813-616d13d34d6e tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51" status: 200 len: 1366 microversion: 2.1 time: 0.148499 Aug 06 14:34:04.356265 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 301/557] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:34:04 2022] GET /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:34:05.228407 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-7afed52e-e9a4-4ea5-9ec6-79f324ce8d03 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:05.229612 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-7afed52e-e9a4-4ea5-9ec6-79f324ce8d03 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:05.235898 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7afed52e-e9a4-4ea5-9ec6-79f324ce8d03 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:05.236371 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7afed52e-e9a4-4ea5-9ec6-79f324ce8d03 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:05.236797 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7afed52e-e9a4-4ea5-9ec6-79f324ce8d03 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:05.237467 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7afed52e-e9a4-4ea5-9ec6-79f324ce8d03 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:05.237912 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7afed52e-e9a4-4ea5-9ec6-79f324ce8d03 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:05.238326 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7afed52e-e9a4-4ea5-9ec6-79f324ce8d03 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:05.371938 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-7afed52e-e9a4-4ea5-9ec6-79f324ce8d03 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:05.379730 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-7afed52e-e9a4-4ea5-9ec6-79f324ce8d03 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:05.381212 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-7afed52e-e9a4-4ea5-9ec6-79f324ce8d03 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:05.382345 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-7afed52e-e9a4-4ea5-9ec6-79f324ce8d03 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1746 microversion: 2.20 time: 0.157819 Aug 06 14:34:05.382912 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 302/558] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:34:05 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1746 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 14:34:05.387155 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-96aa2444-d267-49b3-927a-460ffd777bfe tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:05.387750 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-96aa2444-d267-49b3-927a-460ffd777bfe tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 5a1c9667-a38f-471a-a735-b5dff6828a51] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:05.393046 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-96aa2444-d267-49b3-927a-460ffd777bfe tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:05.393511 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-96aa2444-d267-49b3-927a-460ffd777bfe tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:05.393930 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-96aa2444-d267-49b3-927a-460ffd777bfe tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:05.394597 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-96aa2444-d267-49b3-927a-460ffd777bfe tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:05.395073 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-96aa2444-d267-49b3-927a-460ffd777bfe tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:05.395487 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-96aa2444-d267-49b3-927a-460ffd777bfe tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:05.412997 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_cell1:SELECT=100 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:34:05.524650 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-96aa2444-d267-49b3-927a-460ffd777bfe tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:05.532492 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-96aa2444-d267-49b3-927a-460ffd777bfe tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51" status: 200 len: 1366 microversion: 2.1 time: 0.148652 Aug 06 14:34:05.533048 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 303/559] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:34:05 2022] GET /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:34:06.405063 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-67671d38-39f1-4cfe-925e-c09011f21e7f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:06.405786 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-67671d38-39f1-4cfe-925e-c09011f21e7f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:06.412254 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-67671d38-39f1-4cfe-925e-c09011f21e7f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:06.412789 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-67671d38-39f1-4cfe-925e-c09011f21e7f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:06.413225 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-67671d38-39f1-4cfe-925e-c09011f21e7f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:06.413911 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-67671d38-39f1-4cfe-925e-c09011f21e7f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:06.414362 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-67671d38-39f1-4cfe-925e-c09011f21e7f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:06.414786 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-67671d38-39f1-4cfe-925e-c09011f21e7f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:06.544188 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-67671d38-39f1-4cfe-925e-c09011f21e7f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:06.552036 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-67671d38-39f1-4cfe-925e-c09011f21e7f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:06.553524 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-67671d38-39f1-4cfe-925e-c09011f21e7f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:06.554662 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-67671d38-39f1-4cfe-925e-c09011f21e7f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1746 microversion: 2.20 time: 0.153555 Aug 06 14:34:06.555269 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 304/560] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:34:06 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 14:34:06.560432 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-b7ead0bb-fe09-42fb-9016-c857a853c0a2 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:06.561023 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-b7ead0bb-fe09-42fb-9016-c857a853c0a2 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 5a1c9667-a38f-471a-a735-b5dff6828a51] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:06.567495 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b7ead0bb-fe09-42fb-9016-c857a853c0a2 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:06.567981 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b7ead0bb-fe09-42fb-9016-c857a853c0a2 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:06.568437 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b7ead0bb-fe09-42fb-9016-c857a853c0a2 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:06.569124 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b7ead0bb-fe09-42fb-9016-c857a853c0a2 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:06.569604 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b7ead0bb-fe09-42fb-9016-c857a853c0a2 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:06.570054 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b7ead0bb-fe09-42fb-9016-c857a853c0a2 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:06.703686 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-b7ead0bb-fe09-42fb-9016-c857a853c0a2 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:06.711578 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-b7ead0bb-fe09-42fb-9016-c857a853c0a2 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51" status: 200 len: 1366 microversion: 2.1 time: 0.155357 Aug 06 14:34:06.712434 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 305/561] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:34:06 2022] GET /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:34:06.907938 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-db4d05ad-b6bb-4fef-904c-294b18216d95 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "POST /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 15.635520 Aug 06 14:34:06.908560 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 257/562] 10.222.0.17 () {60 vars in 1323 bytes} [Sat Aug 6 14:33:51 2022] POST /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac/os-volume_attachments => generated 194 bytes in 15637 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 14:34:07.301820 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-9daf43ce-b8b9-4714-9d25-c9a76b2e0f16 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-195965201", "imageRef": "13d7ee60-c9c3-43ee-9861-a9192a114a77", "flavorRef": "452", "networks": [{"uuid": "55772903-5006-4c8e-9ad6-26d3182ad63f"}]}} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:34:07.361738 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.network.neutron [None req-9daf43ce-b8b9-4714-9d25-c9a76b2e0f16 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] validate_networks() for [('55772903-5006-4c8e-9ad6-26d3182ad63f', None, None, None, None, None)] {{(pid=117837) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 14:34:07.584339 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-0c5dcbc2-06ce-4870-b36b-88ad17ec489f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:07.585404 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-0c5dcbc2-06ce-4870-b36b-88ad17ec489f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:07.603058 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0c5dcbc2-06ce-4870-b36b-88ad17ec489f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:07.603543 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0c5dcbc2-06ce-4870-b36b-88ad17ec489f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:07.604043 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0c5dcbc2-06ce-4870-b36b-88ad17ec489f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:07.604739 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0c5dcbc2-06ce-4870-b36b-88ad17ec489f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:07.605185 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0c5dcbc2-06ce-4870-b36b-88ad17ec489f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:07.605605 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0c5dcbc2-06ce-4870-b36b-88ad17ec489f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:07.818775 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-0c5dcbc2-06ce-4870-b36b-88ad17ec489f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:07.832629 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-0c5dcbc2-06ce-4870-b36b-88ad17ec489f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:07.835616 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-0c5dcbc2-06ce-4870-b36b-88ad17ec489f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:07.837639 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-0c5dcbc2-06ce-4870-b36b-88ad17ec489f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1741 microversion: 2.20 time: 0.262781 Aug 06 14:34:07.839400 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 258/563] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:34:07 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1741 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:34:07.839928 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.virt.hardware [None req-9daf43ce-b8b9-4714-9d25-c9a76b2e0f16 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Flavor limits 0:0:0 {{(pid=117837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 14:34:07.840450 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.virt.hardware [None req-9daf43ce-b8b9-4714-9d25-c9a76b2e0f16 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Image limits 0:0:0 {{(pid=117837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 14:34:07.840910 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.virt.hardware [None req-9daf43ce-b8b9-4714-9d25-c9a76b2e0f16 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Flavor pref 0:0:0 {{(pid=117837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 14:34:07.850723 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-6b6a640f-6e35-4d2a-9bfa-ab9e022d676b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:07.851702 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-6b6a640f-6e35-4d2a-9bfa-ab9e022d676b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 5a1c9667-a38f-471a-a735-b5dff6828a51] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:07.853127 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.virt.hardware [None req-9daf43ce-b8b9-4714-9d25-c9a76b2e0f16 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Image pref 0:0:0 {{(pid=117837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 14:34:07.853885 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.virt.hardware [None req-9daf43ce-b8b9-4714-9d25-c9a76b2e0f16 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 14:34:07.859780 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6b6a640f-6e35-4d2a-9bfa-ab9e022d676b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:07.860508 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6b6a640f-6e35-4d2a-9bfa-ab9e022d676b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:07.861218 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6b6a640f-6e35-4d2a-9bfa-ab9e022d676b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:07.862699 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6b6a640f-6e35-4d2a-9bfa-ab9e022d676b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:07.864308 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6b6a640f-6e35-4d2a-9bfa-ab9e022d676b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:07.864964 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6b6a640f-6e35-4d2a-9bfa-ab9e022d676b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:07.889404 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9daf43ce-b8b9-4714-9d25-c9a76b2e0f16 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:07.901962 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9daf43ce-b8b9-4714-9d25-c9a76b2e0f16 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:07.910911 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9daf43ce-b8b9-4714-9d25-c9a76b2e0f16 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:07.918182 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9daf43ce-b8b9-4714-9d25-c9a76b2e0f16 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:07.918993 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9daf43ce-b8b9-4714-9d25-c9a76b2e0f16 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:07.920544 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9daf43ce-b8b9-4714-9d25-c9a76b2e0f16 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:07.959640 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.quota [None req-9daf43ce-b8b9-4714-9d25-c9a76b2e0f16 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Getting quotas for project 59e7a9fef10f4aba994347a5d714f17f. Resources: {'cores', 'instances', 'ram'} {{(pid=117837) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 14:34:07.964338 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.quota [None req-9daf43ce-b8b9-4714-9d25-c9a76b2e0f16 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Getting quotas for user eb6f411ed91946eba54e46799edb12d3 and project 59e7a9fef10f4aba994347a5d714f17f. Resources: {'cores', 'instances', 'ram'} {{(pid=117837) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 14:34:07.977719 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-9daf43ce-b8b9-4714-9d25-c9a76b2e0f16 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Going to run 1 instances... {{(pid=117837) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 14:34:07.982281 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-9daf43ce-b8b9-4714-9d25-c9a76b2e0f16 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] [instance: d30e3f96-04e3-4a5a-b38b-5fdf3be21595] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='13d7ee60-c9c3-43ee-9861-a9192a114a77',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117837) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 14:34:08.067622 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-6b6a640f-6e35-4d2a-9bfa-ab9e022d676b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:08.075831 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-6b6a640f-6e35-4d2a-9bfa-ab9e022d676b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51" status: 200 len: 1366 microversion: 2.1 time: 0.232375 Aug 06 14:34:08.076122 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-9daf43ce-b8b9-4714-9d25-c9a76b2e0f16 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.778842 Aug 06 14:34:08.076768 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 306/564] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Aug 6 14:34:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 780 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 14:34:08.077431 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 259/565] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:34:07 2022] GET /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51 => generated 1366 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:34:08.095786 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-906ce5b0-fb10-41dd-b88f-d3ede4679f4c tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:08.097354 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-906ce5b0-fb10-41dd-b88f-d3ede4679f4c tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] [instance: d30e3f96-04e3-4a5a-b38b-5fdf3be21595] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:08.162521 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-906ce5b0-fb10-41dd-b88f-d3ede4679f4c tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6f411ed91946eba54e46799edb12d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e7a9fef10f4aba994347a5d714f17f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:08.171215 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-906ce5b0-fb10-41dd-b88f-d3ede4679f4c tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] 10.222.0.17 "GET /compute/v2.1/servers/d30e3f96-04e3-4a5a-b38b-5fdf3be21595" status: 200 len: 1218 microversion: 2.1 time: 0.078770 Aug 06 14:34:08.173779 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 307/566] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:34:08 2022] GET /compute/v2.1/servers/d30e3f96-04e3-4a5a-b38b-5fdf3be21595 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:34:08.851691 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [req-a226d0d0-64fb-4514-80b2-31ee97148b32 req-8035d1bb-d139-487a-bb4f-faf5d21f0a0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a1c9667-a38f-471a-a735-b5dff6828a51", "name": "network-vif-plugged", "status": "completed", "tag": "68b8be56-ac5e-4c38-886e-400dc8b14354"}]} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:34:08.864176 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-a226d0d0-64fb-4514-80b2-31ee97148b32 req-8035d1bb-d139-487a-bb4f-faf5d21f0a0c service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:08.865044 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-a226d0d0-64fb-4514-80b2-31ee97148b32 req-8035d1bb-d139-487a-bb4f-faf5d21f0a0c service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:08.865665 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-a226d0d0-64fb-4514-80b2-31ee97148b32 req-8035d1bb-d139-487a-bb4f-faf5d21f0a0c service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:08.865879 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-e4b18f42-dcbf-4802-a9a9-5af8d2b1b003 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:08.866492 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-e4b18f42-dcbf-4802-a9a9-5af8d2b1b003 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:08.873527 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e4b18f42-dcbf-4802-a9a9-5af8d2b1b003 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:08.874004 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e4b18f42-dcbf-4802-a9a9-5af8d2b1b003 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:08.874433 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e4b18f42-dcbf-4802-a9a9-5af8d2b1b003 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:08.875147 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e4b18f42-dcbf-4802-a9a9-5af8d2b1b003 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:08.875597 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e4b18f42-dcbf-4802-a9a9-5af8d2b1b003 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:08.876015 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e4b18f42-dcbf-4802-a9a9-5af8d2b1b003 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:08.880624 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.compute.server_external_events [req-a226d0d0-64fb-4514-80b2-31ee97148b32 req-8035d1bb-d139-487a-bb4f-faf5d21f0a0c service nova] Creating event network-vif-plugged:68b8be56-ac5e-4c38-886e-400dc8b14354 for instance 5a1c9667-a38f-471a-a735-b5dff6828a51 on hv-cinder-85199 Aug 06 14:34:08.886130 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [req-a226d0d0-64fb-4514-80b2-31ee97148b32 req-8035d1bb-d139-487a-bb4f-faf5d21f0a0c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048158 Aug 06 14:34:08.889514 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 260/567] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:34:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:34:09.073450 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-e4b18f42-dcbf-4802-a9a9-5af8d2b1b003 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:09.084364 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-e4b18f42-dcbf-4802-a9a9-5af8d2b1b003 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:09.087387 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-e4b18f42-dcbf-4802-a9a9-5af8d2b1b003 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:09.089693 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-e4b18f42-dcbf-4802-a9a9-5af8d2b1b003 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1741 microversion: 2.20 time: 0.229623 Aug 06 14:34:09.112558 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-381a9fde-809f-4abc-b4e6-1f136d621e50 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:09.113970 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-381a9fde-809f-4abc-b4e6-1f136d621e50 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 5a1c9667-a38f-471a-a735-b5dff6828a51] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:09.118162 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 308/568] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:34:08 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1741 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 14:34:09.122356 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-381a9fde-809f-4abc-b4e6-1f136d621e50 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:09.123395 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-381a9fde-809f-4abc-b4e6-1f136d621e50 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:09.124192 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-381a9fde-809f-4abc-b4e6-1f136d621e50 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:09.125174 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-381a9fde-809f-4abc-b4e6-1f136d621e50 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:09.125950 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-381a9fde-809f-4abc-b4e6-1f136d621e50 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:09.126584 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-381a9fde-809f-4abc-b4e6-1f136d621e50 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:09.195840 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-e76d008c-9451-481c-a799-46602051a074 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:09.196472 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-e76d008c-9451-481c-a799-46602051a074 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] [instance: d30e3f96-04e3-4a5a-b38b-5fdf3be21595] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:09.203681 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e76d008c-9451-481c-a799-46602051a074 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:09.204631 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e76d008c-9451-481c-a799-46602051a074 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:09.206657 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e76d008c-9451-481c-a799-46602051a074 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:09.207478 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e76d008c-9451-481c-a799-46602051a074 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:09.208079 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e76d008c-9451-481c-a799-46602051a074 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:09.208634 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e76d008c-9451-481c-a799-46602051a074 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:09.280714 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-e76d008c-9451-481c-a799-46602051a074 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6f411ed91946eba54e46799edb12d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e7a9fef10f4aba994347a5d714f17f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:09.289880 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-e76d008c-9451-481c-a799-46602051a074 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] 10.222.0.17 "GET /compute/v2.1/servers/d30e3f96-04e3-4a5a-b38b-5fdf3be21595" status: 200 len: 1270 microversion: 2.1 time: 0.097949 Aug 06 14:34:09.303948 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 309/569] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:34:09 2022] GET /compute/v2.1/servers/d30e3f96-04e3-4a5a-b38b-5fdf3be21595 => generated 1270 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:34:09.355182 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-381a9fde-809f-4abc-b4e6-1f136d621e50 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:09.363607 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-381a9fde-809f-4abc-b4e6-1f136d621e50 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51" status: 200 len: 1366 microversion: 2.1 time: 0.257156 Aug 06 14:34:09.364118 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 261/570] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:34:09 2022] GET /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51 => generated 1366 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:34:10.113020 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-4eae6d70-65a9-431f-b831-9aabb2f06e76 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:10.113614 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-4eae6d70-65a9-431f-b831-9aabb2f06e76 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:10.119966 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-4eae6d70-65a9-431f-b831-9aabb2f06e76 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:10.120443 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-4eae6d70-65a9-431f-b831-9aabb2f06e76 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:10.120872 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-4eae6d70-65a9-431f-b831-9aabb2f06e76 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:10.121622 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-4eae6d70-65a9-431f-b831-9aabb2f06e76 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:10.122078 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-4eae6d70-65a9-431f-b831-9aabb2f06e76 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:10.122496 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-4eae6d70-65a9-431f-b831-9aabb2f06e76 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:10.284168 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-4eae6d70-65a9-431f-b831-9aabb2f06e76 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:10.293494 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-4eae6d70-65a9-431f-b831-9aabb2f06e76 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:10.295320 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-4eae6d70-65a9-431f-b831-9aabb2f06e76 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:10.296487 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-4eae6d70-65a9-431f-b831-9aabb2f06e76 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1741 microversion: 2.20 time: 0.188177 Aug 06 14:34:10.311758 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-3dc6d26b-90c3-43fd-9303-e4c7f73ca28b tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:10.312345 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 310/571] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:34:10 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1741 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:34:10.313797 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-3dc6d26b-90c3-43fd-9303-e4c7f73ca28b tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] [instance: d30e3f96-04e3-4a5a-b38b-5fdf3be21595] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:10.320538 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3dc6d26b-90c3-43fd-9303-e4c7f73ca28b tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:10.321091 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3dc6d26b-90c3-43fd-9303-e4c7f73ca28b tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:10.321580 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3dc6d26b-90c3-43fd-9303-e4c7f73ca28b tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:10.323275 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3dc6d26b-90c3-43fd-9303-e4c7f73ca28b tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:10.323973 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3dc6d26b-90c3-43fd-9303-e4c7f73ca28b tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:10.324600 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3dc6d26b-90c3-43fd-9303-e4c7f73ca28b tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:10.384410 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-c969ddd6-6609-44ee-8065-145a41421655 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:10.385660 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-c969ddd6-6609-44ee-8065-145a41421655 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 5a1c9667-a38f-471a-a735-b5dff6828a51] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:10.390514 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-3dc6d26b-90c3-43fd-9303-e4c7f73ca28b tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6f411ed91946eba54e46799edb12d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e7a9fef10f4aba994347a5d714f17f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:10.392010 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c969ddd6-6609-44ee-8065-145a41421655 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:10.392493 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c969ddd6-6609-44ee-8065-145a41421655 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:10.392933 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c969ddd6-6609-44ee-8065-145a41421655 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:10.393642 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c969ddd6-6609-44ee-8065-145a41421655 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:10.394119 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c969ddd6-6609-44ee-8065-145a41421655 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:10.394758 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c969ddd6-6609-44ee-8065-145a41421655 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:10.401361 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-3dc6d26b-90c3-43fd-9303-e4c7f73ca28b tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] 10.222.0.17 "GET /compute/v2.1/servers/d30e3f96-04e3-4a5a-b38b-5fdf3be21595" status: 200 len: 1278 microversion: 2.1 time: 0.093251 Aug 06 14:34:10.415660 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 262/572] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:34:10 2022] GET /compute/v2.1/servers/d30e3f96-04e3-4a5a-b38b-5fdf3be21595 => generated 1278 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:34:10.538853 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-c969ddd6-6609-44ee-8065-145a41421655 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:10.548317 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-c969ddd6-6609-44ee-8065-145a41421655 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51" status: 200 len: 1366 microversion: 2.1 time: 0.168406 Aug 06 14:34:10.555468 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 311/573] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:34:10 2022] GET /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51 => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:34:11.320990 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-4630cab7-a442-4df9-a065-84b17cff8a87 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:11.321735 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-4630cab7-a442-4df9-a065-84b17cff8a87 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:11.328872 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4630cab7-a442-4df9-a065-84b17cff8a87 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:11.329482 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4630cab7-a442-4df9-a065-84b17cff8a87 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:11.330011 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4630cab7-a442-4df9-a065-84b17cff8a87 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:11.330800 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4630cab7-a442-4df9-a065-84b17cff8a87 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:11.331352 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4630cab7-a442-4df9-a065-84b17cff8a87 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:11.331886 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4630cab7-a442-4df9-a065-84b17cff8a87 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:11.422311 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-dca35d21-e8bc-4f5c-a575-92407a8a771c tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:11.423026 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-dca35d21-e8bc-4f5c-a575-92407a8a771c tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] [instance: d30e3f96-04e3-4a5a-b38b-5fdf3be21595] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:11.434740 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-dca35d21-e8bc-4f5c-a575-92407a8a771c tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:11.435388 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-dca35d21-e8bc-4f5c-a575-92407a8a771c tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:11.435898 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-dca35d21-e8bc-4f5c-a575-92407a8a771c tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:11.436772 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-dca35d21-e8bc-4f5c-a575-92407a8a771c tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:11.439409 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-dca35d21-e8bc-4f5c-a575-92407a8a771c tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:11.439858 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-dca35d21-e8bc-4f5c-a575-92407a8a771c tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:11.514960 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-dca35d21-e8bc-4f5c-a575-92407a8a771c tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6f411ed91946eba54e46799edb12d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e7a9fef10f4aba994347a5d714f17f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:11.524685 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-dca35d21-e8bc-4f5c-a575-92407a8a771c tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] 10.222.0.17 "GET /compute/v2.1/servers/d30e3f96-04e3-4a5a-b38b-5fdf3be21595" status: 200 len: 1288 microversion: 2.1 time: 0.106295 Aug 06 14:34:11.527500 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 312/574] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:34:11 2022] GET /compute/v2.1/servers/d30e3f96-04e3-4a5a-b38b-5fdf3be21595 => generated 1288 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:34:11.569415 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-17f16b29-0438-4bf6-8509-7019df8d357d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:11.570442 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-17f16b29-0438-4bf6-8509-7019df8d357d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 5a1c9667-a38f-471a-a735-b5dff6828a51] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:11.577826 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-17f16b29-0438-4bf6-8509-7019df8d357d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:11.578673 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-17f16b29-0438-4bf6-8509-7019df8d357d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:11.579335 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-17f16b29-0438-4bf6-8509-7019df8d357d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:11.580224 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-17f16b29-0438-4bf6-8509-7019df8d357d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:11.580871 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-17f16b29-0438-4bf6-8509-7019df8d357d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:11.581447 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-17f16b29-0438-4bf6-8509-7019df8d357d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:11.638069 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-4630cab7-a442-4df9-a065-84b17cff8a87 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:11.657337 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-4630cab7-a442-4df9-a065-84b17cff8a87 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:11.663975 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-4630cab7-a442-4df9-a065-84b17cff8a87 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:11.665906 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-4630cab7-a442-4df9-a065-84b17cff8a87 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1741 microversion: 2.20 time: 0.348723 Aug 06 14:34:11.667338 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 263/575] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:34:11 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1741 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:34:11.761372 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-17f16b29-0438-4bf6-8509-7019df8d357d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:11.769561 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-17f16b29-0438-4bf6-8509-7019df8d357d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51" status: 200 len: 1366 microversion: 2.1 time: 0.204412 Aug 06 14:34:11.770249 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 313/576] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:34:11 2022] GET /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51 => generated 1366 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:34:12.545604 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-4e3ea20d-b450-4d1a-a498-be95173e18e7 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:12.546144 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-4e3ea20d-b450-4d1a-a498-be95173e18e7 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] [instance: d30e3f96-04e3-4a5a-b38b-5fdf3be21595] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:12.553059 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4e3ea20d-b450-4d1a-a498-be95173e18e7 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:12.553612 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4e3ea20d-b450-4d1a-a498-be95173e18e7 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:12.554109 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4e3ea20d-b450-4d1a-a498-be95173e18e7 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:12.554862 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4e3ea20d-b450-4d1a-a498-be95173e18e7 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:12.555400 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4e3ea20d-b450-4d1a-a498-be95173e18e7 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:12.556044 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4e3ea20d-b450-4d1a-a498-be95173e18e7 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:12.693235 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-4e3ea20d-b450-4d1a-a498-be95173e18e7 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6f411ed91946eba54e46799edb12d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e7a9fef10f4aba994347a5d714f17f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:12.694287 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-91c6ff51-6b07-4c14-bfaf-b7f905b022b4 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:12.694918 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-91c6ff51-6b07-4c14-bfaf-b7f905b022b4 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:12.702354 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-91c6ff51-6b07-4c14-bfaf-b7f905b022b4 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:12.702831 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-91c6ff51-6b07-4c14-bfaf-b7f905b022b4 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:12.703002 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-4e3ea20d-b450-4d1a-a498-be95173e18e7 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] 10.222.0.17 "GET /compute/v2.1/servers/d30e3f96-04e3-4a5a-b38b-5fdf3be21595" status: 200 len: 1318 microversion: 2.1 time: 0.161206 Aug 06 14:34:12.714905 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 264/577] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:34:12 2022] GET /compute/v2.1/servers/d30e3f96-04e3-4a5a-b38b-5fdf3be21595 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:34:12.715244 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-91c6ff51-6b07-4c14-bfaf-b7f905b022b4 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:12.715244 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-91c6ff51-6b07-4c14-bfaf-b7f905b022b4 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:12.715244 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-91c6ff51-6b07-4c14-bfaf-b7f905b022b4 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:12.715244 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-91c6ff51-6b07-4c14-bfaf-b7f905b022b4 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:12.789854 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-4c9e75a7-55b7-445b-8e41-67ad8dc1b73e tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:12.790459 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-4c9e75a7-55b7-445b-8e41-67ad8dc1b73e tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 5a1c9667-a38f-471a-a735-b5dff6828a51] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:12.796588 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4c9e75a7-55b7-445b-8e41-67ad8dc1b73e tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:12.797001 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4c9e75a7-55b7-445b-8e41-67ad8dc1b73e tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:12.797429 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4c9e75a7-55b7-445b-8e41-67ad8dc1b73e tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:12.798115 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4c9e75a7-55b7-445b-8e41-67ad8dc1b73e tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:12.798559 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4c9e75a7-55b7-445b-8e41-67ad8dc1b73e tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:12.811298 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4c9e75a7-55b7-445b-8e41-67ad8dc1b73e tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:12.921970 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-91c6ff51-6b07-4c14-bfaf-b7f905b022b4 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:12.932076 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-91c6ff51-6b07-4c14-bfaf-b7f905b022b4 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:12.933751 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-91c6ff51-6b07-4c14-bfaf-b7f905b022b4 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:12.935041 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-91c6ff51-6b07-4c14-bfaf-b7f905b022b4 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1741 microversion: 2.20 time: 0.244831 Aug 06 14:34:12.935559 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 314/578] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:34:12 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1741 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 14:34:13.128194 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-4c9e75a7-55b7-445b-8e41-67ad8dc1b73e tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:13.139250 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-4c9e75a7-55b7-445b-8e41-67ad8dc1b73e tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51" status: 200 len: 1555 microversion: 2.1 time: 0.353135 Aug 06 14:34:13.149239 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 265/579] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:34:12 2022] GET /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51 => generated 1555 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:34:13.159499 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-08058e0d-24b4-45f7-918a-bc70c2ee579f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:13.159996 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-08058e0d-24b4-45f7-918a-bc70c2ee579f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 5a1c9667-a38f-471a-a735-b5dff6828a51] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:13.161857 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:34:13.166979 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-08058e0d-24b4-45f7-918a-bc70c2ee579f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:13.167485 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-08058e0d-24b4-45f7-918a-bc70c2ee579f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:13.167902 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-08058e0d-24b4-45f7-918a-bc70c2ee579f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:13.168604 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-08058e0d-24b4-45f7-918a-bc70c2ee579f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:13.169066 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-08058e0d-24b4-45f7-918a-bc70c2ee579f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:13.170364 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-08058e0d-24b4-45f7-918a-bc70c2ee579f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:13.257436 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-08058e0d-24b4-45f7-918a-bc70c2ee579f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101682 Aug 06 14:34:13.258056 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 315/580] 10.222.0.17 () {58 vars in 1275 bytes} [Sat Aug 6 14:34:13 2022] GET /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:34:13.724642 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-afb94c42-592f-4826-bc80-6c511534749b tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:13.725927 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-afb94c42-592f-4826-bc80-6c511534749b tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] [instance: d30e3f96-04e3-4a5a-b38b-5fdf3be21595] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:13.733412 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-afb94c42-592f-4826-bc80-6c511534749b tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:13.734064 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-afb94c42-592f-4826-bc80-6c511534749b tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:13.734741 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-afb94c42-592f-4826-bc80-6c511534749b tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:13.735771 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-afb94c42-592f-4826-bc80-6c511534749b tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:13.736329 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-afb94c42-592f-4826-bc80-6c511534749b tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:13.736966 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-afb94c42-592f-4826-bc80-6c511534749b tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:13.963848 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-f53c4f17-08bb-465a-86d5-9a7540bef883 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:13.964867 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-f53c4f17-08bb-465a-86d5-9a7540bef883 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:13.978168 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f53c4f17-08bb-465a-86d5-9a7540bef883 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:13.979260 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f53c4f17-08bb-465a-86d5-9a7540bef883 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:13.979776 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f53c4f17-08bb-465a-86d5-9a7540bef883 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:13.980557 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f53c4f17-08bb-465a-86d5-9a7540bef883 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:13.982713 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f53c4f17-08bb-465a-86d5-9a7540bef883 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:13.983262 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f53c4f17-08bb-465a-86d5-9a7540bef883 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:14.250579 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-f53c4f17-08bb-465a-86d5-9a7540bef883 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:14.265659 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-f53c4f17-08bb-465a-86d5-9a7540bef883 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:14.267166 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-f53c4f17-08bb-465a-86d5-9a7540bef883 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:14.299290 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-f53c4f17-08bb-465a-86d5-9a7540bef883 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1741 microversion: 2.20 time: 0.332335 Aug 06 14:34:14.300204 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 316/581] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:34:13 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1741 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:34:14.311543 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [req-3e7719b2-ddcb-40a0-b92b-28c1436bd688 req-79a2a5a3-2156-4532-81ff-e30bbe909531 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d30e3f96-04e3-4a5a-b38b-5fdf3be21595", "tag": "0828391c-6aa9-43b3-956d-fcbcc522c19b"}]} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:34:14.357234 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-3e7719b2-ddcb-40a0-b92b-28c1436bd688 req-79a2a5a3-2156-4532-81ff-e30bbe909531 service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:14.357725 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-3e7719b2-ddcb-40a0-b92b-28c1436bd688 req-79a2a5a3-2156-4532-81ff-e30bbe909531 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:14.360903 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-3e7719b2-ddcb-40a0-b92b-28c1436bd688 req-79a2a5a3-2156-4532-81ff-e30bbe909531 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:14.385006 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.compute.server_external_events [req-3e7719b2-ddcb-40a0-b92b-28c1436bd688 req-79a2a5a3-2156-4532-81ff-e30bbe909531 service nova] Creating event network-changed:0828391c-6aa9-43b3-956d-fcbcc522c19b for instance d30e3f96-04e3-4a5a-b38b-5fdf3be21595 on hv-cinder-85199 Aug 06 14:34:14.391553 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [req-3e7719b2-ddcb-40a0-b92b-28c1436bd688 req-79a2a5a3-2156-4532-81ff-e30bbe909531 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090009 Aug 06 14:34:14.392543 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 317/582] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:34:14.473559 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-afb94c42-592f-4826-bc80-6c511534749b tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6f411ed91946eba54e46799edb12d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e7a9fef10f4aba994347a5d714f17f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:14.483418 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-afb94c42-592f-4826-bc80-6c511534749b tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] 10.222.0.17 "GET /compute/v2.1/servers/d30e3f96-04e3-4a5a-b38b-5fdf3be21595" status: 200 len: 1318 microversion: 2.1 time: 0.762414 Aug 06 14:34:14.487887 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 266/583] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:34:13 2022] GET /compute/v2.1/servers/d30e3f96-04e3-4a5a-b38b-5fdf3be21595 => generated 1318 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:34:15.326189 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-4db4a931-71d9-4b57-b990-0aa07af9eed9 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:15.327009 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-4db4a931-71d9-4b57-b990-0aa07af9eed9 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:15.334700 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-4db4a931-71d9-4b57-b990-0aa07af9eed9 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:15.335739 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-4db4a931-71d9-4b57-b990-0aa07af9eed9 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:15.336413 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-4db4a931-71d9-4b57-b990-0aa07af9eed9 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:15.337332 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-4db4a931-71d9-4b57-b990-0aa07af9eed9 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:15.338009 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-4db4a931-71d9-4b57-b990-0aa07af9eed9 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:15.338495 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-4db4a931-71d9-4b57-b990-0aa07af9eed9 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:15.507885 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-926d12c1-8797-4511-addb-c99b0b31ccbb tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:15.508797 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-926d12c1-8797-4511-addb-c99b0b31ccbb tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] [instance: d30e3f96-04e3-4a5a-b38b-5fdf3be21595] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:15.541624 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-926d12c1-8797-4511-addb-c99b0b31ccbb tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:15.542374 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-926d12c1-8797-4511-addb-c99b0b31ccbb tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:15.542953 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-926d12c1-8797-4511-addb-c99b0b31ccbb tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:15.543949 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-926d12c1-8797-4511-addb-c99b0b31ccbb tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:15.544606 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-926d12c1-8797-4511-addb-c99b0b31ccbb tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:15.546359 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-926d12c1-8797-4511-addb-c99b0b31ccbb tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:15.568294 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-4db4a931-71d9-4b57-b990-0aa07af9eed9 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:15.584632 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-4db4a931-71d9-4b57-b990-0aa07af9eed9 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:15.586145 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-4db4a931-71d9-4b57-b990-0aa07af9eed9 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:15.587364 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-4db4a931-71d9-4b57-b990-0aa07af9eed9 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1741 microversion: 2.20 time: 0.265958 Aug 06 14:34:15.599074 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 318/584] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:34:15 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1741 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:34:15.739067 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-e4a162f5-4a10-4cf0-b5cd-92d09fdac6e8 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:34:15.748298 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e4a162f5-4a10-4cf0-b5cd-92d09fdac6e8 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:15.753296 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e4a162f5-4a10-4cf0-b5cd-92d09fdac6e8 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:15.754404 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e4a162f5-4a10-4cf0-b5cd-92d09fdac6e8 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:15.795770 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-926d12c1-8797-4511-addb-c99b0b31ccbb tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6f411ed91946eba54e46799edb12d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e7a9fef10f4aba994347a5d714f17f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:15.810262 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-926d12c1-8797-4511-addb-c99b0b31ccbb tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] 10.222.0.17 "GET /compute/v2.1/servers/d30e3f96-04e3-4a5a-b38b-5fdf3be21595" status: 200 len: 1318 microversion: 2.1 time: 0.306088 Aug 06 14:34:15.814391 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 267/585] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:34:15 2022] GET /compute/v2.1/servers/d30e3f96-04e3-4a5a-b38b-5fdf3be21595 => generated 1318 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:34:15.866955 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-e4a162f5-4a10-4cf0-b5cd-92d09fdac6e8 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Going to try to stop instance {{(pid=117837) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 06 14:34:15.938011 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-e4a162f5-4a10-4cf0-b5cd-92d09fdac6e8 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "POST /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac/action" status: 202 len: 0 microversion: 2.1 time: 0.202958 Aug 06 14:34:15.939151 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 319/586] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Aug 6 14:34:15 2022] POST /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac/action => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 06 14:34:15.950787 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-a235b32e-4fbc-46bd-9dc7-8aecddaf1176 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:15.951689 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-a235b32e-4fbc-46bd-9dc7-8aecddaf1176 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:15.964548 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a235b32e-4fbc-46bd-9dc7-8aecddaf1176 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:15.965782 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a235b32e-4fbc-46bd-9dc7-8aecddaf1176 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:15.966235 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a235b32e-4fbc-46bd-9dc7-8aecddaf1176 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:15.967017 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a235b32e-4fbc-46bd-9dc7-8aecddaf1176 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:15.967456 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a235b32e-4fbc-46bd-9dc7-8aecddaf1176 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:15.967887 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a235b32e-4fbc-46bd-9dc7-8aecddaf1176 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:16.151568 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-a235b32e-4fbc-46bd-9dc7-8aecddaf1176 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:16.160004 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-a235b32e-4fbc-46bd-9dc7-8aecddaf1176 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1722 microversion: 2.1 time: 0.216502 Aug 06 14:34:16.160588 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 268/587] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:34:15 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1722 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:34:16.415779 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [req-8e01e4d1-2ba7-4cd4-9c96-2951452b4a03 req-4c9ab678-ec1a-4670-815f-dc09834310f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a1c9667-a38f-471a-a735-b5dff6828a51", "tag": "68b8be56-ac5e-4c38-886e-400dc8b14354"}]} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:34:16.428061 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-8e01e4d1-2ba7-4cd4-9c96-2951452b4a03 req-4c9ab678-ec1a-4670-815f-dc09834310f9 service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:16.428895 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-8e01e4d1-2ba7-4cd4-9c96-2951452b4a03 req-4c9ab678-ec1a-4670-815f-dc09834310f9 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:16.429515 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-8e01e4d1-2ba7-4cd4-9c96-2951452b4a03 req-4c9ab678-ec1a-4670-815f-dc09834310f9 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:16.442484 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.compute.server_external_events [req-8e01e4d1-2ba7-4cd4-9c96-2951452b4a03 req-4c9ab678-ec1a-4670-815f-dc09834310f9 service nova] Creating event network-changed:68b8be56-ac5e-4c38-886e-400dc8b14354 for instance 5a1c9667-a38f-471a-a735-b5dff6828a51 on hv-cinder-85199 Aug 06 14:34:16.448234 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [req-8e01e4d1-2ba7-4cd4-9c96-2951452b4a03 req-4c9ab678-ec1a-4670-815f-dc09834310f9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036953 Aug 06 14:34:16.449428 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 320/588] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:34:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:34:16.617465 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-728cab79-731d-4b05-b75e-c1a05e629431 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:16.621374 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-728cab79-731d-4b05-b75e-c1a05e629431 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:16.630041 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-728cab79-731d-4b05-b75e-c1a05e629431 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:16.630835 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-728cab79-731d-4b05-b75e-c1a05e629431 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:16.631626 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-728cab79-731d-4b05-b75e-c1a05e629431 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:16.632591 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-728cab79-731d-4b05-b75e-c1a05e629431 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:16.633657 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-728cab79-731d-4b05-b75e-c1a05e629431 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:16.635135 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-728cab79-731d-4b05-b75e-c1a05e629431 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:16.803386 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-728cab79-731d-4b05-b75e-c1a05e629431 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:16.813547 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-728cab79-731d-4b05-b75e-c1a05e629431 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:16.815436 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-728cab79-731d-4b05-b75e-c1a05e629431 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:16.816816 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-728cab79-731d-4b05-b75e-c1a05e629431 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1741 microversion: 2.20 time: 0.203381 Aug 06 14:34:16.817376 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 269/589] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:34:16 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1741 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:34:16.834270 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-59b6313a-c13d-4bdf-9415-64d8602ef205 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:16.835041 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-59b6313a-c13d-4bdf-9415-64d8602ef205 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] [instance: d30e3f96-04e3-4a5a-b38b-5fdf3be21595] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:16.857276 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-59b6313a-c13d-4bdf-9415-64d8602ef205 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:16.857966 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-59b6313a-c13d-4bdf-9415-64d8602ef205 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:16.858567 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-59b6313a-c13d-4bdf-9415-64d8602ef205 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:16.859537 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-59b6313a-c13d-4bdf-9415-64d8602ef205 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:16.860207 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-59b6313a-c13d-4bdf-9415-64d8602ef205 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:16.860872 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-59b6313a-c13d-4bdf-9415-64d8602ef205 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:17.022053 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-59b6313a-c13d-4bdf-9415-64d8602ef205 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6f411ed91946eba54e46799edb12d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e7a9fef10f4aba994347a5d714f17f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:17.031261 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-59b6313a-c13d-4bdf-9415-64d8602ef205 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] 10.222.0.17 "GET /compute/v2.1/servers/d30e3f96-04e3-4a5a-b38b-5fdf3be21595" status: 200 len: 1318 microversion: 2.1 time: 0.201150 Aug 06 14:34:17.032841 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 321/590] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:34:16 2022] GET /compute/v2.1/servers/d30e3f96-04e3-4a5a-b38b-5fdf3be21595 => generated 1318 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:34:17.181446 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-789821e6-1f08-4089-b86d-cb472b341847 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:17.182675 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-789821e6-1f08-4089-b86d-cb472b341847 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:17.188880 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-789821e6-1f08-4089-b86d-cb472b341847 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:17.189367 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-789821e6-1f08-4089-b86d-cb472b341847 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:17.189802 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-789821e6-1f08-4089-b86d-cb472b341847 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:17.190491 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-789821e6-1f08-4089-b86d-cb472b341847 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:17.190980 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-789821e6-1f08-4089-b86d-cb472b341847 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:17.191414 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-789821e6-1f08-4089-b86d-cb472b341847 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:17.333425 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-789821e6-1f08-4089-b86d-cb472b341847 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:17.342008 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-789821e6-1f08-4089-b86d-cb472b341847 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1722 microversion: 2.1 time: 0.164644 Aug 06 14:34:17.342809 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 270/591] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:34:17 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:34:17.842362 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-c6b09943-6daa-4300-9d12-a0c43e9421de tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:17.842993 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-c6b09943-6daa-4300-9d12-a0c43e9421de tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:17.849583 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c6b09943-6daa-4300-9d12-a0c43e9421de tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:17.850256 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c6b09943-6daa-4300-9d12-a0c43e9421de tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:17.850857 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c6b09943-6daa-4300-9d12-a0c43e9421de tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:17.852128 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c6b09943-6daa-4300-9d12-a0c43e9421de tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:17.852958 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c6b09943-6daa-4300-9d12-a0c43e9421de tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:17.853793 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c6b09943-6daa-4300-9d12-a0c43e9421de tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:17.876031 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:34:17.950248 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_cell0:SELECT=2 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:34:18.007153 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-c6b09943-6daa-4300-9d12-a0c43e9421de tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:18.018085 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-c6b09943-6daa-4300-9d12-a0c43e9421de tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:18.020276 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-c6b09943-6daa-4300-9d12-a0c43e9421de tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:18.021461 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-c6b09943-6daa-4300-9d12-a0c43e9421de tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1741 microversion: 2.20 time: 0.183588 Aug 06 14:34:18.022785 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 322/592] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:34:17 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1741 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:34:18.051578 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-55612d9d-0b22-4081-a808-8771b5a51d18 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:18.052178 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-55612d9d-0b22-4081-a808-8771b5a51d18 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] [instance: d30e3f96-04e3-4a5a-b38b-5fdf3be21595] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:18.059324 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-55612d9d-0b22-4081-a808-8771b5a51d18 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:18.059794 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-55612d9d-0b22-4081-a808-8771b5a51d18 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:18.060222 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-55612d9d-0b22-4081-a808-8771b5a51d18 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:18.060904 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-55612d9d-0b22-4081-a808-8771b5a51d18 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:18.061414 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-55612d9d-0b22-4081-a808-8771b5a51d18 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:18.061833 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-55612d9d-0b22-4081-a808-8771b5a51d18 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:18.213541 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-55612d9d-0b22-4081-a808-8771b5a51d18 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6f411ed91946eba54e46799edb12d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e7a9fef10f4aba994347a5d714f17f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:18.226745 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-55612d9d-0b22-4081-a808-8771b5a51d18 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] 10.222.0.17 "GET /compute/v2.1/servers/d30e3f96-04e3-4a5a-b38b-5fdf3be21595" status: 200 len: 1318 microversion: 2.1 time: 0.178829 Aug 06 14:34:18.228120 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 271/593] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:34:18 2022] GET /compute/v2.1/servers/d30e3f96-04e3-4a5a-b38b-5fdf3be21595 => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:34:18.363635 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-0b411700-9760-4385-a22d-0381c869414b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:18.364277 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-0b411700-9760-4385-a22d-0381c869414b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:18.366142 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_cell0:SELECT=8 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:34:18.372309 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0b411700-9760-4385-a22d-0381c869414b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:18.372797 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0b411700-9760-4385-a22d-0381c869414b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:18.373254 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0b411700-9760-4385-a22d-0381c869414b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:18.373954 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0b411700-9760-4385-a22d-0381c869414b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:18.374412 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0b411700-9760-4385-a22d-0381c869414b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:18.374829 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0b411700-9760-4385-a22d-0381c869414b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:18.544575 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-0b411700-9760-4385-a22d-0381c869414b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:18.568970 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-0b411700-9760-4385-a22d-0381c869414b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1722 microversion: 2.1 time: 0.208983 Aug 06 14:34:18.569896 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 323/594] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:34:18 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1722 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:34:19.046204 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-d1a42be7-45f5-4b1f-9084-e6fa8a34603d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:19.047054 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-d1a42be7-45f5-4b1f-9084-e6fa8a34603d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:19.052977 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d1a42be7-45f5-4b1f-9084-e6fa8a34603d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:19.053605 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d1a42be7-45f5-4b1f-9084-e6fa8a34603d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:19.053957 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d1a42be7-45f5-4b1f-9084-e6fa8a34603d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:19.054901 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d1a42be7-45f5-4b1f-9084-e6fa8a34603d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:19.064267 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d1a42be7-45f5-4b1f-9084-e6fa8a34603d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:19.064900 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d1a42be7-45f5-4b1f-9084-e6fa8a34603d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:19.239261 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-d1a42be7-45f5-4b1f-9084-e6fa8a34603d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:19.245539 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-d1a42be7-45f5-4b1f-9084-e6fa8a34603d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:19.247206 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-d1a42be7-45f5-4b1f-9084-e6fa8a34603d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:19.248584 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-d1a42be7-45f5-4b1f-9084-e6fa8a34603d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1741 microversion: 2.20 time: 0.206385 Aug 06 14:34:19.250977 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 272/595] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:34:19 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1741 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:34:19.253087 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-42da7b08-f7c5-4554-98e2-b667d456889d tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:19.253708 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-42da7b08-f7c5-4554-98e2-b667d456889d tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] [instance: d30e3f96-04e3-4a5a-b38b-5fdf3be21595] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:19.260920 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-42da7b08-f7c5-4554-98e2-b667d456889d tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:19.261422 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-42da7b08-f7c5-4554-98e2-b667d456889d tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:19.261840 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-42da7b08-f7c5-4554-98e2-b667d456889d tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:19.262542 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-42da7b08-f7c5-4554-98e2-b667d456889d tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:19.263204 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-42da7b08-f7c5-4554-98e2-b667d456889d tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:19.263632 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-42da7b08-f7c5-4554-98e2-b667d456889d tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:19.404568 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-42da7b08-f7c5-4554-98e2-b667d456889d tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6f411ed91946eba54e46799edb12d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e7a9fef10f4aba994347a5d714f17f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:19.412166 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-42da7b08-f7c5-4554-98e2-b667d456889d tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] 10.222.0.17 "GET /compute/v2.1/servers/d30e3f96-04e3-4a5a-b38b-5fdf3be21595" status: 200 len: 1318 microversion: 2.1 time: 0.162862 Aug 06 14:34:19.412610 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 324/596] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:34:19 2022] GET /compute/v2.1/servers/d30e3f96-04e3-4a5a-b38b-5fdf3be21595 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:34:19.592010 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-2a1260bf-5f59-48b7-816f-26bea6d4f995 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:19.592604 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-2a1260bf-5f59-48b7-816f-26bea6d4f995 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:19.598709 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2a1260bf-5f59-48b7-816f-26bea6d4f995 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:19.599412 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2a1260bf-5f59-48b7-816f-26bea6d4f995 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:19.599851 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2a1260bf-5f59-48b7-816f-26bea6d4f995 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:19.600532 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2a1260bf-5f59-48b7-816f-26bea6d4f995 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:19.601000 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2a1260bf-5f59-48b7-816f-26bea6d4f995 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:19.601405 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2a1260bf-5f59-48b7-816f-26bea6d4f995 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:19.736991 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-2a1260bf-5f59-48b7-816f-26bea6d4f995 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:19.740559 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:34:19.745782 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-2a1260bf-5f59-48b7-816f-26bea6d4f995 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1722 microversion: 2.1 time: 0.158678 Aug 06 14:34:19.746342 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 273/597] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:34:19 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:34:20.272106 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-de17b833-68c1-430c-bd4b-5859f0f87a87 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:20.272713 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-de17b833-68c1-430c-bd4b-5859f0f87a87 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:20.279710 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-de17b833-68c1-430c-bd4b-5859f0f87a87 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:20.280197 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-de17b833-68c1-430c-bd4b-5859f0f87a87 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:20.280647 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-de17b833-68c1-430c-bd4b-5859f0f87a87 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:20.281324 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-de17b833-68c1-430c-bd4b-5859f0f87a87 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:20.281775 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-de17b833-68c1-430c-bd4b-5859f0f87a87 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:20.282198 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-de17b833-68c1-430c-bd4b-5859f0f87a87 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:20.434015 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-0e726c85-a192-4d2b-ad7d-1be9315602b0 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:20.434625 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-0e726c85-a192-4d2b-ad7d-1be9315602b0 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] [instance: d30e3f96-04e3-4a5a-b38b-5fdf3be21595] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:20.442731 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0e726c85-a192-4d2b-ad7d-1be9315602b0 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:20.443252 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0e726c85-a192-4d2b-ad7d-1be9315602b0 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:20.443677 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0e726c85-a192-4d2b-ad7d-1be9315602b0 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:20.444556 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0e726c85-a192-4d2b-ad7d-1be9315602b0 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:20.445028 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0e726c85-a192-4d2b-ad7d-1be9315602b0 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:20.445794 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0e726c85-a192-4d2b-ad7d-1be9315602b0 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:20.522188 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-de17b833-68c1-430c-bd4b-5859f0f87a87 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:20.531951 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-de17b833-68c1-430c-bd4b-5859f0f87a87 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:20.534072 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-de17b833-68c1-430c-bd4b-5859f0f87a87 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:20.536254 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-de17b833-68c1-430c-bd4b-5859f0f87a87 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1741 microversion: 2.20 time: 0.267810 Aug 06 14:34:20.537157 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 325/598] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:34:20 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1741 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 14:34:20.592146 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-0e726c85-a192-4d2b-ad7d-1be9315602b0 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6f411ed91946eba54e46799edb12d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e7a9fef10f4aba994347a5d714f17f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:20.599480 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-0e726c85-a192-4d2b-ad7d-1be9315602b0 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] 10.222.0.17 "GET /compute/v2.1/servers/d30e3f96-04e3-4a5a-b38b-5fdf3be21595" status: 200 len: 1318 microversion: 2.1 time: 0.170270 Aug 06 14:34:20.600099 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 274/599] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:34:20 2022] GET /compute/v2.1/servers/d30e3f96-04e3-4a5a-b38b-5fdf3be21595 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:34:20.765612 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-295095b1-520a-4c3d-bff3-6cb03529e20a tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:20.766321 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-295095b1-520a-4c3d-bff3-6cb03529e20a tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:20.772292 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-295095b1-520a-4c3d-bff3-6cb03529e20a tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:20.772781 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-295095b1-520a-4c3d-bff3-6cb03529e20a tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:20.773302 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-295095b1-520a-4c3d-bff3-6cb03529e20a tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:20.774086 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-295095b1-520a-4c3d-bff3-6cb03529e20a tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:20.774601 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-295095b1-520a-4c3d-bff3-6cb03529e20a tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:20.775118 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-295095b1-520a-4c3d-bff3-6cb03529e20a tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:20.908026 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-295095b1-520a-4c3d-bff3-6cb03529e20a tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:20.916545 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-295095b1-520a-4c3d-bff3-6cb03529e20a tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1722 microversion: 2.1 time: 0.154363 Aug 06 14:34:20.917115 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 326/600] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:34:20 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:34:21.561001 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-5fe5173b-9bab-4b2b-9ac6-26d39cb8cb3b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:21.561602 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-5fe5173b-9bab-4b2b-9ac6-26d39cb8cb3b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:21.569114 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5fe5173b-9bab-4b2b-9ac6-26d39cb8cb3b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:21.569600 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5fe5173b-9bab-4b2b-9ac6-26d39cb8cb3b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:21.570122 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5fe5173b-9bab-4b2b-9ac6-26d39cb8cb3b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:21.570962 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5fe5173b-9bab-4b2b-9ac6-26d39cb8cb3b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:21.571935 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5fe5173b-9bab-4b2b-9ac6-26d39cb8cb3b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:21.572871 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5fe5173b-9bab-4b2b-9ac6-26d39cb8cb3b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:21.645451 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-70352bf8-ffa1-445c-a952-2eb1fad4a434 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:21.657280 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-70352bf8-ffa1-445c-a952-2eb1fad4a434 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] [instance: d30e3f96-04e3-4a5a-b38b-5fdf3be21595] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:21.666975 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-70352bf8-ffa1-445c-a952-2eb1fad4a434 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:21.667479 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-70352bf8-ffa1-445c-a952-2eb1fad4a434 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:21.667917 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-70352bf8-ffa1-445c-a952-2eb1fad4a434 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:21.668828 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-70352bf8-ffa1-445c-a952-2eb1fad4a434 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:21.669294 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-70352bf8-ffa1-445c-a952-2eb1fad4a434 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:21.669719 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-70352bf8-ffa1-445c-a952-2eb1fad4a434 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:21.718539 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-5fe5173b-9bab-4b2b-9ac6-26d39cb8cb3b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:21.726806 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-5fe5173b-9bab-4b2b-9ac6-26d39cb8cb3b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:21.728369 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-5fe5173b-9bab-4b2b-9ac6-26d39cb8cb3b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:21.729554 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-5fe5173b-9bab-4b2b-9ac6-26d39cb8cb3b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1723 microversion: 2.20 time: 0.173152 Aug 06 14:34:21.735043 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 275/601] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:34:21 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:34:21.937977 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-e862e86b-f3b1-4074-af68-02801153fa55 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:21.938693 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-e862e86b-f3b1-4074-af68-02801153fa55 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:21.944806 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e862e86b-f3b1-4074-af68-02801153fa55 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:21.945397 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e862e86b-f3b1-4074-af68-02801153fa55 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:21.945898 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e862e86b-f3b1-4074-af68-02801153fa55 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:21.946595 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e862e86b-f3b1-4074-af68-02801153fa55 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:21.947687 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e862e86b-f3b1-4074-af68-02801153fa55 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:21.948050 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e862e86b-f3b1-4074-af68-02801153fa55 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:22.096666 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-e862e86b-f3b1-4074-af68-02801153fa55 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:22.104925 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-e862e86b-f3b1-4074-af68-02801153fa55 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1722 microversion: 2.1 time: 0.170842 Aug 06 14:34:22.105679 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 276/602] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:34:21 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:34:22.105964 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-70352bf8-ffa1-445c-a952-2eb1fad4a434 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6f411ed91946eba54e46799edb12d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e7a9fef10f4aba994347a5d714f17f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:22.114819 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-70352bf8-ffa1-445c-a952-2eb1fad4a434 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] 10.222.0.17 "GET /compute/v2.1/servers/d30e3f96-04e3-4a5a-b38b-5fdf3be21595" status: 200 len: 1318 microversion: 2.1 time: 0.495615 Aug 06 14:34:22.114819 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 327/603] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:34:21 2022] GET /compute/v2.1/servers/d30e3f96-04e3-4a5a-b38b-5fdf3be21595 => generated 1318 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:34:22.753600 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-a72a3967-b942-42d4-a93c-cbf0a862b9ec tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:22.754203 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-a72a3967-b942-42d4-a93c-cbf0a862b9ec tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:22.760648 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a72a3967-b942-42d4-a93c-cbf0a862b9ec tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:22.761132 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a72a3967-b942-42d4-a93c-cbf0a862b9ec tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:22.761562 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a72a3967-b942-42d4-a93c-cbf0a862b9ec tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:22.762243 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a72a3967-b942-42d4-a93c-cbf0a862b9ec tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:22.762699 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a72a3967-b942-42d4-a93c-cbf0a862b9ec tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:22.763156 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a72a3967-b942-42d4-a93c-cbf0a862b9ec tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:22.896467 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-a72a3967-b942-42d4-a93c-cbf0a862b9ec tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:22.904430 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-a72a3967-b942-42d4-a93c-cbf0a862b9ec tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:22.905939 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-a72a3967-b942-42d4-a93c-cbf0a862b9ec tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:22.907139 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-a72a3967-b942-42d4-a93c-cbf0a862b9ec tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1723 microversion: 2.20 time: 0.157489 Aug 06 14:34:22.907698 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 277/604] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:34:22 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:34:23.125456 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-2edf7eaa-e068-49ec-be1c-64642a220e66 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:23.126066 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-2edf7eaa-e068-49ec-be1c-64642a220e66 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:23.132574 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2edf7eaa-e068-49ec-be1c-64642a220e66 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:23.133056 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2edf7eaa-e068-49ec-be1c-64642a220e66 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:23.133357 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-60a32001-c97d-4f54-a5cf-5eb61ad3a089 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:23.133480 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2edf7eaa-e068-49ec-be1c-64642a220e66 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:23.134083 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-60a32001-c97d-4f54-a5cf-5eb61ad3a089 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] [instance: d30e3f96-04e3-4a5a-b38b-5fdf3be21595] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:23.134180 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2edf7eaa-e068-49ec-be1c-64642a220e66 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:23.134625 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2edf7eaa-e068-49ec-be1c-64642a220e66 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:23.135072 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2edf7eaa-e068-49ec-be1c-64642a220e66 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:23.140025 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-60a32001-c97d-4f54-a5cf-5eb61ad3a089 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:23.140500 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-60a32001-c97d-4f54-a5cf-5eb61ad3a089 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:23.140924 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-60a32001-c97d-4f54-a5cf-5eb61ad3a089 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:23.141603 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-60a32001-c97d-4f54-a5cf-5eb61ad3a089 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:23.142045 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-60a32001-c97d-4f54-a5cf-5eb61ad3a089 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:23.142466 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-60a32001-c97d-4f54-a5cf-5eb61ad3a089 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:23.267330 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-2edf7eaa-e068-49ec-be1c-64642a220e66 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:23.274467 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-60a32001-c97d-4f54-a5cf-5eb61ad3a089 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6f411ed91946eba54e46799edb12d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e7a9fef10f4aba994347a5d714f17f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:23.275716 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-2edf7eaa-e068-49ec-be1c-64642a220e66 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1722 microversion: 2.1 time: 0.153580 Aug 06 14:34:23.276277 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 328/605] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:34:23 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:34:23.282707 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-60a32001-c97d-4f54-a5cf-5eb61ad3a089 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] 10.222.0.17 "GET /compute/v2.1/servers/d30e3f96-04e3-4a5a-b38b-5fdf3be21595" status: 200 len: 1318 microversion: 2.1 time: 0.153233 Aug 06 14:34:23.283233 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 278/606] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:34:23 2022] GET /compute/v2.1/servers/d30e3f96-04e3-4a5a-b38b-5fdf3be21595 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:34:23.664260 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [req-633a1dbc-e40f-403c-9d71-d3a8ac59754e req-81864b64-784d-4373-a645-d67cb8de3296 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d30e3f96-04e3-4a5a-b38b-5fdf3be21595", "name": "network-vif-plugged", "status": "completed", "tag": "0828391c-6aa9-43b3-956d-fcbcc522c19b"}]} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:34:23.673967 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-633a1dbc-e40f-403c-9d71-d3a8ac59754e req-81864b64-784d-4373-a645-d67cb8de3296 service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:23.674444 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-633a1dbc-e40f-403c-9d71-d3a8ac59754e req-81864b64-784d-4373-a645-d67cb8de3296 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:23.674935 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-633a1dbc-e40f-403c-9d71-d3a8ac59754e req-81864b64-784d-4373-a645-d67cb8de3296 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:23.686054 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.compute.server_external_events [req-633a1dbc-e40f-403c-9d71-d3a8ac59754e req-81864b64-784d-4373-a645-d67cb8de3296 service nova] Creating event network-vif-plugged:0828391c-6aa9-43b3-956d-fcbcc522c19b for instance d30e3f96-04e3-4a5a-b38b-5fdf3be21595 on hv-cinder-85199 Aug 06 14:34:23.690941 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [req-633a1dbc-e40f-403c-9d71-d3a8ac59754e req-81864b64-784d-4373-a645-d67cb8de3296 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030367 Aug 06 14:34:23.691527 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 329/607] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:34:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 14:34:23.930694 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-bc93e152-3352-4a67-8039-75052ea54a8e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:23.931853 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-bc93e152-3352-4a67-8039-75052ea54a8e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:23.938143 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-bc93e152-3352-4a67-8039-75052ea54a8e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:23.938620 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-bc93e152-3352-4a67-8039-75052ea54a8e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:23.939085 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-bc93e152-3352-4a67-8039-75052ea54a8e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:23.939763 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-bc93e152-3352-4a67-8039-75052ea54a8e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:23.940221 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-bc93e152-3352-4a67-8039-75052ea54a8e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:23.940640 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-bc93e152-3352-4a67-8039-75052ea54a8e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:24.066968 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-bc93e152-3352-4a67-8039-75052ea54a8e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:24.075357 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-bc93e152-3352-4a67-8039-75052ea54a8e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:24.076866 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-bc93e152-3352-4a67-8039-75052ea54a8e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:24.078006 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-bc93e152-3352-4a67-8039-75052ea54a8e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1723 microversion: 2.20 time: 0.151240 Aug 06 14:34:24.078568 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 279/608] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:34:23 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:34:24.297574 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-1272193f-cf0c-43b5-9f86-58be28b44fe2 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:24.298499 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-1272193f-cf0c-43b5-9f86-58be28b44fe2 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:24.302802 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-bd250ad1-c994-4f2f-9f54-1413d9b33aeb tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:24.303446 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-bd250ad1-c994-4f2f-9f54-1413d9b33aeb tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] [instance: d30e3f96-04e3-4a5a-b38b-5fdf3be21595] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:24.304614 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1272193f-cf0c-43b5-9f86-58be28b44fe2 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:24.305099 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1272193f-cf0c-43b5-9f86-58be28b44fe2 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:24.305532 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1272193f-cf0c-43b5-9f86-58be28b44fe2 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:24.306483 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1272193f-cf0c-43b5-9f86-58be28b44fe2 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:24.306953 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1272193f-cf0c-43b5-9f86-58be28b44fe2 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:24.307379 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1272193f-cf0c-43b5-9f86-58be28b44fe2 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:24.309729 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-bd250ad1-c994-4f2f-9f54-1413d9b33aeb tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:24.310258 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-bd250ad1-c994-4f2f-9f54-1413d9b33aeb tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:24.310696 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-bd250ad1-c994-4f2f-9f54-1413d9b33aeb tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:24.311424 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-bd250ad1-c994-4f2f-9f54-1413d9b33aeb tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:24.311876 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-bd250ad1-c994-4f2f-9f54-1413d9b33aeb tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:24.312295 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-bd250ad1-c994-4f2f-9f54-1413d9b33aeb tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:24.445995 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-bd250ad1-c994-4f2f-9f54-1413d9b33aeb tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6f411ed91946eba54e46799edb12d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e7a9fef10f4aba994347a5d714f17f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:24.453931 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-bd250ad1-c994-4f2f-9f54-1413d9b33aeb tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] 10.222.0.17 "GET /compute/v2.1/servers/d30e3f96-04e3-4a5a-b38b-5fdf3be21595" status: 200 len: 1318 microversion: 2.1 time: 0.154837 Aug 06 14:34:24.454616 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 280/609] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:34:24 2022] GET /compute/v2.1/servers/d30e3f96-04e3-4a5a-b38b-5fdf3be21595 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:34:24.479025 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-1272193f-cf0c-43b5-9f86-58be28b44fe2 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:24.487018 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-1272193f-cf0c-43b5-9f86-58be28b44fe2 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1722 microversion: 2.1 time: 0.194256 Aug 06 14:34:24.487590 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 330/610] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:34:24 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:34:25.101540 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-e45dafc2-293c-4d40-81a8-6ef77c70a91e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:25.102070 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-e45dafc2-293c-4d40-81a8-6ef77c70a91e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:25.108917 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e45dafc2-293c-4d40-81a8-6ef77c70a91e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:25.109400 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e45dafc2-293c-4d40-81a8-6ef77c70a91e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:25.109830 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e45dafc2-293c-4d40-81a8-6ef77c70a91e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:25.110509 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e45dafc2-293c-4d40-81a8-6ef77c70a91e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:25.110982 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e45dafc2-293c-4d40-81a8-6ef77c70a91e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:25.111402 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e45dafc2-293c-4d40-81a8-6ef77c70a91e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:25.242441 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-e45dafc2-293c-4d40-81a8-6ef77c70a91e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:25.250939 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-e45dafc2-293c-4d40-81a8-6ef77c70a91e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:25.252576 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-e45dafc2-293c-4d40-81a8-6ef77c70a91e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:25.253752 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-e45dafc2-293c-4d40-81a8-6ef77c70a91e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1723 microversion: 2.20 time: 0.156120 Aug 06 14:34:25.254250 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 281/611] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:34:25 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:34:25.475291 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-d01ab8e0-2e3d-49e9-a539-4fe6e76b9ac8 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:25.475928 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-d01ab8e0-2e3d-49e9-a539-4fe6e76b9ac8 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] [instance: d30e3f96-04e3-4a5a-b38b-5fdf3be21595] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:25.483506 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d01ab8e0-2e3d-49e9-a539-4fe6e76b9ac8 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:25.483982 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d01ab8e0-2e3d-49e9-a539-4fe6e76b9ac8 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:25.484415 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d01ab8e0-2e3d-49e9-a539-4fe6e76b9ac8 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:25.485101 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d01ab8e0-2e3d-49e9-a539-4fe6e76b9ac8 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:25.485548 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d01ab8e0-2e3d-49e9-a539-4fe6e76b9ac8 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:25.485965 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d01ab8e0-2e3d-49e9-a539-4fe6e76b9ac8 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:25.507722 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-539a3398-665b-44e7-a06b-f8d0b07e1a67 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:25.508327 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-539a3398-665b-44e7-a06b-f8d0b07e1a67 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:25.514148 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-539a3398-665b-44e7-a06b-f8d0b07e1a67 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:25.514620 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-539a3398-665b-44e7-a06b-f8d0b07e1a67 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:25.515121 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-539a3398-665b-44e7-a06b-f8d0b07e1a67 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:25.515915 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-539a3398-665b-44e7-a06b-f8d0b07e1a67 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:25.516362 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-539a3398-665b-44e7-a06b-f8d0b07e1a67 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:25.516795 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-539a3398-665b-44e7-a06b-f8d0b07e1a67 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:25.646556 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-d01ab8e0-2e3d-49e9-a539-4fe6e76b9ac8 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6f411ed91946eba54e46799edb12d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e7a9fef10f4aba994347a5d714f17f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:25.658237 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-d01ab8e0-2e3d-49e9-a539-4fe6e76b9ac8 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] 10.222.0.17 "GET /compute/v2.1/servers/d30e3f96-04e3-4a5a-b38b-5fdf3be21595" status: 200 len: 1318 microversion: 2.1 time: 0.186347 Aug 06 14:34:25.658720 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 331/612] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:34:25 2022] GET /compute/v2.1/servers/d30e3f96-04e3-4a5a-b38b-5fdf3be21595 => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:34:25.661253 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-539a3398-665b-44e7-a06b-f8d0b07e1a67 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:25.670429 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-539a3398-665b-44e7-a06b-f8d0b07e1a67 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1722 microversion: 2.1 time: 0.166391 Aug 06 14:34:25.671048 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 282/613] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:34:25 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:34:25.709858 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [req-cd8f20d4-c3b6-4493-9361-1c20a752a77e req-055d4306-7b4a-4883-b787-b7a05de303e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cf29bae-83f8-43e3-9118-0fea5a019ff8", "name": "network-vif-unplugged", "status": "completed", "tag": "988ecdda-956b-4c8b-8ee4-231ef3ed0bb2"}]} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:34:25.719999 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-cd8f20d4-c3b6-4493-9361-1c20a752a77e req-055d4306-7b4a-4883-b787-b7a05de303e5 service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:25.720478 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-cd8f20d4-c3b6-4493-9361-1c20a752a77e req-055d4306-7b4a-4883-b787-b7a05de303e5 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:25.721478 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-cd8f20d4-c3b6-4493-9361-1c20a752a77e req-055d4306-7b4a-4883-b787-b7a05de303e5 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:25.733291 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.compute.server_external_events [req-cd8f20d4-c3b6-4493-9361-1c20a752a77e req-055d4306-7b4a-4883-b787-b7a05de303e5 service nova] Creating event network-vif-unplugged:988ecdda-956b-4c8b-8ee4-231ef3ed0bb2 for instance 5cf29bae-83f8-43e3-9118-0fea5a019ff8 on hv-cinder-85199 Aug 06 14:34:25.738095 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [req-cd8f20d4-c3b6-4493-9361-1c20a752a77e req-055d4306-7b4a-4883-b787-b7a05de303e5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031992 Aug 06 14:34:25.738686 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 332/614] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:34:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:34:26.276316 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-531ace81-0014-4797-b5a6-f5cd624df543 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:26.276846 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-531ace81-0014-4797-b5a6-f5cd624df543 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:26.283280 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-531ace81-0014-4797-b5a6-f5cd624df543 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:26.283756 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-531ace81-0014-4797-b5a6-f5cd624df543 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:26.284182 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-531ace81-0014-4797-b5a6-f5cd624df543 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:26.284859 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-531ace81-0014-4797-b5a6-f5cd624df543 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:26.285304 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-531ace81-0014-4797-b5a6-f5cd624df543 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:26.285726 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-531ace81-0014-4797-b5a6-f5cd624df543 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:26.422259 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-531ace81-0014-4797-b5a6-f5cd624df543 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:26.430080 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-531ace81-0014-4797-b5a6-f5cd624df543 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:26.432436 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-531ace81-0014-4797-b5a6-f5cd624df543 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:26.433576 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-531ace81-0014-4797-b5a6-f5cd624df543 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1723 microversion: 2.20 time: 0.161502 Aug 06 14:34:26.434134 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 283/615] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:34:26 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:34:26.690762 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-69d4f69f-8460-4ffd-9355-61baa37e9411 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:26.691490 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-69d4f69f-8460-4ffd-9355-61baa37e9411 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] [instance: d30e3f96-04e3-4a5a-b38b-5fdf3be21595] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:26.691630 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-72dff1e7-e177-46f8-9faa-c6742eec02d2 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:26.692218 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-72dff1e7-e177-46f8-9faa-c6742eec02d2 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:26.698184 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-69d4f69f-8460-4ffd-9355-61baa37e9411 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:26.698558 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-72dff1e7-e177-46f8-9faa-c6742eec02d2 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:26.698669 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-69d4f69f-8460-4ffd-9355-61baa37e9411 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:26.699091 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-72dff1e7-e177-46f8-9faa-c6742eec02d2 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:26.699215 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-69d4f69f-8460-4ffd-9355-61baa37e9411 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:26.699541 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-72dff1e7-e177-46f8-9faa-c6742eec02d2 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:26.699797 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-69d4f69f-8460-4ffd-9355-61baa37e9411 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:26.701326 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-72dff1e7-e177-46f8-9faa-c6742eec02d2 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:26.701462 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-69d4f69f-8460-4ffd-9355-61baa37e9411 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:26.701462 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-69d4f69f-8460-4ffd-9355-61baa37e9411 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:26.701641 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-72dff1e7-e177-46f8-9faa-c6742eec02d2 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:26.701641 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-72dff1e7-e177-46f8-9faa-c6742eec02d2 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:26.836806 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-69d4f69f-8460-4ffd-9355-61baa37e9411 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6f411ed91946eba54e46799edb12d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e7a9fef10f4aba994347a5d714f17f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:26.837263 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-72dff1e7-e177-46f8-9faa-c6742eec02d2 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:26.846099 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-72dff1e7-e177-46f8-9faa-c6742eec02d2 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1722 microversion: 2.1 time: 0.158165 Aug 06 14:34:26.859164 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-69d4f69f-8460-4ffd-9355-61baa37e9411 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] 10.222.0.17 "GET /compute/v2.1/servers/d30e3f96-04e3-4a5a-b38b-5fdf3be21595" status: 200 len: 1318 microversion: 2.1 time: 0.172904 Aug 06 14:34:26.859572 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 284/616] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:34:26 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:34:26.860521 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 333/617] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:34:26 2022] GET /compute/v2.1/servers/d30e3f96-04e3-4a5a-b38b-5fdf3be21595 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:34:27.456797 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-138637e1-a48d-4dc2-a40d-3c6325c0a76f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:27.457402 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-138637e1-a48d-4dc2-a40d-3c6325c0a76f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:27.463736 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-138637e1-a48d-4dc2-a40d-3c6325c0a76f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:27.464218 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-138637e1-a48d-4dc2-a40d-3c6325c0a76f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:27.464651 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-138637e1-a48d-4dc2-a40d-3c6325c0a76f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:27.465340 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-138637e1-a48d-4dc2-a40d-3c6325c0a76f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:27.465790 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-138637e1-a48d-4dc2-a40d-3c6325c0a76f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:27.466212 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-138637e1-a48d-4dc2-a40d-3c6325c0a76f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:27.595698 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-138637e1-a48d-4dc2-a40d-3c6325c0a76f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:27.604364 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-138637e1-a48d-4dc2-a40d-3c6325c0a76f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:27.605891 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-138637e1-a48d-4dc2-a40d-3c6325c0a76f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:27.607083 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-138637e1-a48d-4dc2-a40d-3c6325c0a76f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1666 microversion: 2.20 time: 0.154155 Aug 06 14:34:27.607650 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 285/618] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:34:27 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1666 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:34:27.629668 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-bc809045-d0c9-4390-90fe-0b8bfbca05d4 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0af1c2dd-cef8-4259-95fb-890ab02c6bc1"}} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:34:27.632031 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-bc809045-d0c9-4390-90fe-0b8bfbca05d4 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:27.638993 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-bc809045-d0c9-4390-90fe-0b8bfbca05d4 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:27.639475 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-bc809045-d0c9-4390-90fe-0b8bfbca05d4 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:27.639907 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-bc809045-d0c9-4390-90fe-0b8bfbca05d4 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:27.640611 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-bc809045-d0c9-4390-90fe-0b8bfbca05d4 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:27.641058 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-bc809045-d0c9-4390-90fe-0b8bfbca05d4 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:27.641473 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-bc809045-d0c9-4390-90fe-0b8bfbca05d4 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:27.868170 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-2f4bbeab-bb99-4bb1-9912-e3f03e36ba8d tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:27.868872 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-2f4bbeab-bb99-4bb1-9912-e3f03e36ba8d tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:27.874661 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2f4bbeab-bb99-4bb1-9912-e3f03e36ba8d tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:27.875171 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2f4bbeab-bb99-4bb1-9912-e3f03e36ba8d tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:27.875606 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2f4bbeab-bb99-4bb1-9912-e3f03e36ba8d tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:27.876306 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2f4bbeab-bb99-4bb1-9912-e3f03e36ba8d tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:27.876744 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2f4bbeab-bb99-4bb1-9912-e3f03e36ba8d tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:27.877350 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2f4bbeab-bb99-4bb1-9912-e3f03e36ba8d tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:27.929068 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-bc809045-d0c9-4390-90fe-0b8bfbca05d4 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "POST /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.303414 Aug 06 14:34:27.929870 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 334/619] 10.222.0.17 () {62 vars in 1364 bytes} [Sat Aug 6 14:34:27 2022] POST /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8/os-volume_attachments => generated 188 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 14:34:27.934888 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-c09fb99b-0d9b-438b-91e0-d5b85cff9746 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:27.936875 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-c09fb99b-0d9b-438b-91e0-d5b85cff9746 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] [instance: d30e3f96-04e3-4a5a-b38b-5fdf3be21595] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:27.942806 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c09fb99b-0d9b-438b-91e0-d5b85cff9746 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:27.943328 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c09fb99b-0d9b-438b-91e0-d5b85cff9746 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:27.943755 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c09fb99b-0d9b-438b-91e0-d5b85cff9746 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:27.944624 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c09fb99b-0d9b-438b-91e0-d5b85cff9746 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:27.945234 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c09fb99b-0d9b-438b-91e0-d5b85cff9746 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:27.945821 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c09fb99b-0d9b-438b-91e0-d5b85cff9746 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:28.037491 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-2f4bbeab-bb99-4bb1-9912-e3f03e36ba8d tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:28.047921 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-2f4bbeab-bb99-4bb1-9912-e3f03e36ba8d tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1722 microversion: 2.1 time: 0.183422 Aug 06 14:34:28.048467 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 286/620] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:34:27 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:34:28.066598 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-a8d67e97-81bc-498d-9a58-aca63f3614f3 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:34:28.067231 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-a8d67e97-81bc-498d-9a58-aca63f3614f3 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:28.074125 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a8d67e97-81bc-498d-9a58-aca63f3614f3 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:28.074293 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a8d67e97-81bc-498d-9a58-aca63f3614f3 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:28.074671 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a8d67e97-81bc-498d-9a58-aca63f3614f3 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:28.075389 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a8d67e97-81bc-498d-9a58-aca63f3614f3 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:28.075841 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a8d67e97-81bc-498d-9a58-aca63f3614f3 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:28.076264 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a8d67e97-81bc-498d-9a58-aca63f3614f3 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:28.093703 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-c09fb99b-0d9b-438b-91e0-d5b85cff9746 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6f411ed91946eba54e46799edb12d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e7a9fef10f4aba994347a5d714f17f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:28.101552 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-c09fb99b-0d9b-438b-91e0-d5b85cff9746 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] 10.222.0.17 "GET /compute/v2.1/servers/d30e3f96-04e3-4a5a-b38b-5fdf3be21595" status: 200 len: 1505 microversion: 2.1 time: 0.170506 Aug 06 14:34:28.113836 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 335/621] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:34:27 2022] GET /compute/v2.1/servers/d30e3f96-04e3-4a5a-b38b-5fdf3be21595 => generated 1505 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:34:28.121287 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-de2614c3-940d-4393-a310-c7c5256a0bf0 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "061a7745-4bbc-4ae1-911c-cbbb10fffe85", "device": "/dev/sdb"}} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:34:28.123889 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-a8d67e97-81bc-498d-9a58-aca63f3614f3 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117838) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 06 14:34:28.124217 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-de2614c3-940d-4393-a310-c7c5256a0bf0 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] [instance: d30e3f96-04e3-4a5a-b38b-5fdf3be21595] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:28.130148 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-de2614c3-940d-4393-a310-c7c5256a0bf0 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:28.130621 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-de2614c3-940d-4393-a310-c7c5256a0bf0 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:28.131084 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-de2614c3-940d-4393-a310-c7c5256a0bf0 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:28.131757 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-de2614c3-940d-4393-a310-c7c5256a0bf0 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:28.132203 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-de2614c3-940d-4393-a310-c7c5256a0bf0 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:28.132616 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-de2614c3-940d-4393-a310-c7c5256a0bf0 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:28.194270 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-a8d67e97-81bc-498d-9a58-aca63f3614f3 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "POST /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8/action" status: 202 len: 0 microversion: 2.20 time: 0.131361 Aug 06 14:34:28.194901 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 287/622] 10.222.0.17 () {62 vars in 1319 bytes} [Sat Aug 6 14:34:28 2022] POST /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 06 14:34:28.203469 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-bcadd8b1-b56c-46bd-a41a-7ed869ae13c8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:28.204061 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-bcadd8b1-b56c-46bd-a41a-7ed869ae13c8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:28.210130 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-bcadd8b1-b56c-46bd-a41a-7ed869ae13c8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:28.210613 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-bcadd8b1-b56c-46bd-a41a-7ed869ae13c8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:28.211091 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-bcadd8b1-b56c-46bd-a41a-7ed869ae13c8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:28.211784 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-bcadd8b1-b56c-46bd-a41a-7ed869ae13c8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:28.212271 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-bcadd8b1-b56c-46bd-a41a-7ed869ae13c8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:28.213227 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-bcadd8b1-b56c-46bd-a41a-7ed869ae13c8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:28.357374 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-bcadd8b1-b56c-46bd-a41a-7ed869ae13c8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:28.369153 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-bcadd8b1-b56c-46bd-a41a-7ed869ae13c8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:28.370686 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-bcadd8b1-b56c-46bd-a41a-7ed869ae13c8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:28.371877 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-bcadd8b1-b56c-46bd-a41a-7ed869ae13c8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1752 microversion: 2.20 time: 0.172119 Aug 06 14:34:28.374988 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 288/623] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:34:28 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1752 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 14:34:28.412874 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=3,nova_cell1:UPDATE=6 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:34:28.431937 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-de2614c3-940d-4393-a310-c7c5256a0bf0 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] 10.222.0.17 "POST /compute/v2.1/servers/d30e3f96-04e3-4a5a-b38b-5fdf3be21595/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.313760 Aug 06 14:34:28.432832 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 336/624] 10.222.0.17 () {60 vars in 1323 bytes} [Sat Aug 6 14:34:28 2022] POST /compute/v2.1/servers/d30e3f96-04e3-4a5a-b38b-5fdf3be21595/os-volume_attachments => generated 194 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 14:34:29.069427 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-9b63bdcd-6f21-4c3a-9024-faa505252c94 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:29.069948 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-9b63bdcd-6f21-4c3a-9024-faa505252c94 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:29.076598 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9b63bdcd-6f21-4c3a-9024-faa505252c94 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:29.077075 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9b63bdcd-6f21-4c3a-9024-faa505252c94 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:29.077500 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9b63bdcd-6f21-4c3a-9024-faa505252c94 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:29.078178 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9b63bdcd-6f21-4c3a-9024-faa505252c94 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:29.078808 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9b63bdcd-6f21-4c3a-9024-faa505252c94 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:29.079289 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9b63bdcd-6f21-4c3a-9024-faa505252c94 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:29.097383 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:34:29.215293 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-9b63bdcd-6f21-4c3a-9024-faa505252c94 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:29.223259 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-9b63bdcd-6f21-4c3a-9024-faa505252c94 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1722 microversion: 2.1 time: 0.157814 Aug 06 14:34:29.223811 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 289/625] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:34:29 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:34:29.396844 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-4fb53b36-5b6a-4f29-9d3b-f280230416ba tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:29.397750 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-4fb53b36-5b6a-4f29-9d3b-f280230416ba tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:29.404546 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-4fb53b36-5b6a-4f29-9d3b-f280230416ba tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:29.405034 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-4fb53b36-5b6a-4f29-9d3b-f280230416ba tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:29.405511 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-4fb53b36-5b6a-4f29-9d3b-f280230416ba tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:29.406192 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-4fb53b36-5b6a-4f29-9d3b-f280230416ba tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:29.406655 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-4fb53b36-5b6a-4f29-9d3b-f280230416ba tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:29.407105 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-4fb53b36-5b6a-4f29-9d3b-f280230416ba tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:29.547920 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-4fb53b36-5b6a-4f29-9d3b-f280230416ba tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:29.556773 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-4fb53b36-5b6a-4f29-9d3b-f280230416ba tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:29.558329 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-4fb53b36-5b6a-4f29-9d3b-f280230416ba tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:29.559577 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-4fb53b36-5b6a-4f29-9d3b-f280230416ba tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1754 microversion: 2.20 time: 0.167794 Aug 06 14:34:29.560207 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 337/626] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:34:29 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:34:30.245345 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-31710f0b-fad2-4524-9fdf-25c3a1194e2b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:30.245955 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-31710f0b-fad2-4524-9fdf-25c3a1194e2b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:30.252306 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-31710f0b-fad2-4524-9fdf-25c3a1194e2b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:30.252787 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-31710f0b-fad2-4524-9fdf-25c3a1194e2b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:30.253222 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-31710f0b-fad2-4524-9fdf-25c3a1194e2b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:30.253908 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-31710f0b-fad2-4524-9fdf-25c3a1194e2b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:30.254366 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-31710f0b-fad2-4524-9fdf-25c3a1194e2b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:30.254795 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-31710f0b-fad2-4524-9fdf-25c3a1194e2b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:30.384724 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-31710f0b-fad2-4524-9fdf-25c3a1194e2b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:30.392800 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-31710f0b-fad2-4524-9fdf-25c3a1194e2b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1722 microversion: 2.1 time: 0.151968 Aug 06 14:34:30.393372 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 290/627] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:34:30 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:34:30.584997 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-0dd01fa0-fe71-48cc-9c5d-1b68f49d7e31 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:30.585601 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-0dd01fa0-fe71-48cc-9c5d-1b68f49d7e31 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:30.592528 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0dd01fa0-fe71-48cc-9c5d-1b68f49d7e31 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:30.592966 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0dd01fa0-fe71-48cc-9c5d-1b68f49d7e31 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:30.593334 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0dd01fa0-fe71-48cc-9c5d-1b68f49d7e31 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:30.594017 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0dd01fa0-fe71-48cc-9c5d-1b68f49d7e31 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:30.594460 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0dd01fa0-fe71-48cc-9c5d-1b68f49d7e31 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:30.594891 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0dd01fa0-fe71-48cc-9c5d-1b68f49d7e31 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:30.723279 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-0dd01fa0-fe71-48cc-9c5d-1b68f49d7e31 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:30.732301 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-0dd01fa0-fe71-48cc-9c5d-1b68f49d7e31 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:30.733782 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-0dd01fa0-fe71-48cc-9c5d-1b68f49d7e31 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:30.734947 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-0dd01fa0-fe71-48cc-9c5d-1b68f49d7e31 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1754 microversion: 2.20 time: 0.153800 Aug 06 14:34:30.735494 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 338/628] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:34:30 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1754 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:34:31.413690 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-6696e086-4c97-422c-b583-e051901dd73c tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:31.414286 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-6696e086-4c97-422c-b583-e051901dd73c tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:31.416599 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:34:31.421642 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6696e086-4c97-422c-b583-e051901dd73c tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:31.422111 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6696e086-4c97-422c-b583-e051901dd73c tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:31.422535 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6696e086-4c97-422c-b583-e051901dd73c tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:31.423257 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6696e086-4c97-422c-b583-e051901dd73c tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:31.423702 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6696e086-4c97-422c-b583-e051901dd73c tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:31.424114 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6696e086-4c97-422c-b583-e051901dd73c tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:31.555632 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-6696e086-4c97-422c-b583-e051901dd73c tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:31.568393 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-6696e086-4c97-422c-b583-e051901dd73c tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1722 microversion: 2.1 time: 0.158505 Aug 06 14:34:31.568963 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 291/629] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:34:31 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:34:31.757682 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-edade1f1-3a79-44da-8c10-1fceafc95259 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:31.758231 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-edade1f1-3a79-44da-8c10-1fceafc95259 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:31.764596 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-edade1f1-3a79-44da-8c10-1fceafc95259 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:31.765078 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-edade1f1-3a79-44da-8c10-1fceafc95259 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:31.765513 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-edade1f1-3a79-44da-8c10-1fceafc95259 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:31.766200 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-edade1f1-3a79-44da-8c10-1fceafc95259 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:31.766650 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-edade1f1-3a79-44da-8c10-1fceafc95259 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:31.767106 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-edade1f1-3a79-44da-8c10-1fceafc95259 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:31.903601 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-edade1f1-3a79-44da-8c10-1fceafc95259 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:31.911783 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-edade1f1-3a79-44da-8c10-1fceafc95259 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:31.913262 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-edade1f1-3a79-44da-8c10-1fceafc95259 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:31.914398 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-edade1f1-3a79-44da-8c10-1fceafc95259 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1754 microversion: 2.20 time: 0.160629 Aug 06 14:34:31.914973 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 339/630] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:34:31 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:34:32.591096 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-14a6833e-ef6d-4b2b-8f25-565a3bcb9d45 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:32.591631 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-14a6833e-ef6d-4b2b-8f25-565a3bcb9d45 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:32.597973 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-14a6833e-ef6d-4b2b-8f25-565a3bcb9d45 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:32.598450 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-14a6833e-ef6d-4b2b-8f25-565a3bcb9d45 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:32.598933 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-14a6833e-ef6d-4b2b-8f25-565a3bcb9d45 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:32.599621 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-14a6833e-ef6d-4b2b-8f25-565a3bcb9d45 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:32.600074 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-14a6833e-ef6d-4b2b-8f25-565a3bcb9d45 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:32.600496 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-14a6833e-ef6d-4b2b-8f25-565a3bcb9d45 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:32.730574 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-14a6833e-ef6d-4b2b-8f25-565a3bcb9d45 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:32.739255 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-14a6833e-ef6d-4b2b-8f25-565a3bcb9d45 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1722 microversion: 2.1 time: 0.152599 Aug 06 14:34:32.739834 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 292/631] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:34:32 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:34:32.938190 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-e40f2e71-ebbf-4e92-b7df-25f7afcd5988 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:32.938823 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-e40f2e71-ebbf-4e92-b7df-25f7afcd5988 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:32.945236 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e40f2e71-ebbf-4e92-b7df-25f7afcd5988 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:32.945712 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e40f2e71-ebbf-4e92-b7df-25f7afcd5988 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:32.946144 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e40f2e71-ebbf-4e92-b7df-25f7afcd5988 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:32.947502 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e40f2e71-ebbf-4e92-b7df-25f7afcd5988 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:32.947955 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e40f2e71-ebbf-4e92-b7df-25f7afcd5988 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:32.948377 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e40f2e71-ebbf-4e92-b7df-25f7afcd5988 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:33.073991 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-e40f2e71-ebbf-4e92-b7df-25f7afcd5988 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:33.082214 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-e40f2e71-ebbf-4e92-b7df-25f7afcd5988 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:33.083739 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-e40f2e71-ebbf-4e92-b7df-25f7afcd5988 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:33.084893 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-e40f2e71-ebbf-4e92-b7df-25f7afcd5988 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1754 microversion: 2.20 time: 0.150584 Aug 06 14:34:33.085448 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 340/632] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:34:32 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1754 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:34:33.759670 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-22b41768-dbdb-4255-a965-e3b8e3f24d4e tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:33.760288 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-22b41768-dbdb-4255-a965-e3b8e3f24d4e tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:33.766642 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-22b41768-dbdb-4255-a965-e3b8e3f24d4e tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:33.767153 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-22b41768-dbdb-4255-a965-e3b8e3f24d4e tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:33.767586 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-22b41768-dbdb-4255-a965-e3b8e3f24d4e tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:33.768270 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-22b41768-dbdb-4255-a965-e3b8e3f24d4e tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:33.768722 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-22b41768-dbdb-4255-a965-e3b8e3f24d4e tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:33.769139 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-22b41768-dbdb-4255-a965-e3b8e3f24d4e tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:33.897735 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-22b41768-dbdb-4255-a965-e3b8e3f24d4e tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:33.906053 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-22b41768-dbdb-4255-a965-e3b8e3f24d4e tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1722 microversion: 2.1 time: 0.150240 Aug 06 14:34:33.906615 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 293/633] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:34:33 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:34:34.107571 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-caf9f253-c9ca-4ccc-9fb8-90fd6710931d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:34.108133 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-caf9f253-c9ca-4ccc-9fb8-90fd6710931d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:34.114385 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-caf9f253-c9ca-4ccc-9fb8-90fd6710931d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:34.114855 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-caf9f253-c9ca-4ccc-9fb8-90fd6710931d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:34.115311 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-caf9f253-c9ca-4ccc-9fb8-90fd6710931d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:34.115984 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-caf9f253-c9ca-4ccc-9fb8-90fd6710931d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:34.116431 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-caf9f253-c9ca-4ccc-9fb8-90fd6710931d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:34.116846 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-caf9f253-c9ca-4ccc-9fb8-90fd6710931d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:34.252114 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-caf9f253-c9ca-4ccc-9fb8-90fd6710931d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:34.261207 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-caf9f253-c9ca-4ccc-9fb8-90fd6710931d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:34.262717 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-caf9f253-c9ca-4ccc-9fb8-90fd6710931d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:34.263972 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-caf9f253-c9ca-4ccc-9fb8-90fd6710931d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1754 microversion: 2.20 time: 0.160346 Aug 06 14:34:34.264523 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 341/634] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:34:34 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:34:34.927112 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-a2af4855-1f8c-49a9-9750-14cc0d724265 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:34.927716 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-a2af4855-1f8c-49a9-9750-14cc0d724265 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:34.934828 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a2af4855-1f8c-49a9-9750-14cc0d724265 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:34.935420 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a2af4855-1f8c-49a9-9750-14cc0d724265 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:34.935850 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a2af4855-1f8c-49a9-9750-14cc0d724265 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:34.936714 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a2af4855-1f8c-49a9-9750-14cc0d724265 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:34.937173 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a2af4855-1f8c-49a9-9750-14cc0d724265 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:34.937592 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a2af4855-1f8c-49a9-9750-14cc0d724265 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:35.062217 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-a2af4855-1f8c-49a9-9750-14cc0d724265 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:35.070032 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-a2af4855-1f8c-49a9-9750-14cc0d724265 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1722 microversion: 2.1 time: 0.146718 Aug 06 14:34:35.070522 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 294/635] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:34:34 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1722 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:34:35.287832 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-2ee23c6a-4613-4bcd-9faf-35a7cfb20b1f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:35.288427 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-2ee23c6a-4613-4bcd-9faf-35a7cfb20b1f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:35.295373 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2ee23c6a-4613-4bcd-9faf-35a7cfb20b1f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:35.295841 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2ee23c6a-4613-4bcd-9faf-35a7cfb20b1f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:35.296262 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2ee23c6a-4613-4bcd-9faf-35a7cfb20b1f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:35.296932 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2ee23c6a-4613-4bcd-9faf-35a7cfb20b1f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:35.297378 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2ee23c6a-4613-4bcd-9faf-35a7cfb20b1f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:35.297788 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2ee23c6a-4613-4bcd-9faf-35a7cfb20b1f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:35.424661 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-2ee23c6a-4613-4bcd-9faf-35a7cfb20b1f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:35.433269 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-2ee23c6a-4613-4bcd-9faf-35a7cfb20b1f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:35.434756 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-2ee23c6a-4613-4bcd-9faf-35a7cfb20b1f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:35.435930 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-2ee23c6a-4613-4bcd-9faf-35a7cfb20b1f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1754 microversion: 2.20 time: 0.152093 Aug 06 14:34:35.436480 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 342/636] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:34:35 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1754 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:34:36.091331 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-f4ad9d7c-a731-42d8-8984-021feaafb80a tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:36.091866 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-f4ad9d7c-a731-42d8-8984-021feaafb80a tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:36.098241 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f4ad9d7c-a731-42d8-8984-021feaafb80a tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:36.098719 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f4ad9d7c-a731-42d8-8984-021feaafb80a tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:36.099180 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f4ad9d7c-a731-42d8-8984-021feaafb80a tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:36.099905 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f4ad9d7c-a731-42d8-8984-021feaafb80a tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:36.100362 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f4ad9d7c-a731-42d8-8984-021feaafb80a tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:36.100792 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f4ad9d7c-a731-42d8-8984-021feaafb80a tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:36.231637 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-f4ad9d7c-a731-42d8-8984-021feaafb80a tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:36.239490 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-f4ad9d7c-a731-42d8-8984-021feaafb80a tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1699 microversion: 2.1 time: 0.152152 Aug 06 14:34:36.240053 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 295/637] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:34:36 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1699 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:34:36.260069 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-0d052cc8-8fcf-4131-b39f-bfe4e007cad3 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:34:36.265936 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0d052cc8-8fcf-4131-b39f-bfe4e007cad3 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:36.266408 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0d052cc8-8fcf-4131-b39f-bfe4e007cad3 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:36.266834 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0d052cc8-8fcf-4131-b39f-bfe4e007cad3 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:36.299268 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-0d052cc8-8fcf-4131-b39f-bfe4e007cad3 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Going to try to start instance {{(pid=117837) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 06 14:34:36.341970 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-0d052cc8-8fcf-4131-b39f-bfe4e007cad3 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "POST /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac/action" status: 202 len: 0 microversion: 2.1 time: 0.085487 Aug 06 14:34:36.342478 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 343/638] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Aug 6 14:34:36 2022] POST /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 14:34:36.351192 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-08d2cbc3-2eef-4700-a505-3df21b3ea401 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:36.351885 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-08d2cbc3-2eef-4700-a505-3df21b3ea401 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:36.358203 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-08d2cbc3-2eef-4700-a505-3df21b3ea401 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:36.358685 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-08d2cbc3-2eef-4700-a505-3df21b3ea401 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:36.359162 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-08d2cbc3-2eef-4700-a505-3df21b3ea401 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:36.359850 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-08d2cbc3-2eef-4700-a505-3df21b3ea401 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:36.360300 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-08d2cbc3-2eef-4700-a505-3df21b3ea401 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:36.360725 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-08d2cbc3-2eef-4700-a505-3df21b3ea401 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:36.459103 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-6156075b-3c00-4e64-a6af-7d0de13ba50f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:36.459952 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-6156075b-3c00-4e64-a6af-7d0de13ba50f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:36.466190 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6156075b-3c00-4e64-a6af-7d0de13ba50f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:36.466956 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6156075b-3c00-4e64-a6af-7d0de13ba50f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:36.467619 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6156075b-3c00-4e64-a6af-7d0de13ba50f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:36.468936 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6156075b-3c00-4e64-a6af-7d0de13ba50f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:36.469702 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6156075b-3c00-4e64-a6af-7d0de13ba50f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:36.469984 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6156075b-3c00-4e64-a6af-7d0de13ba50f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:36.496402 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-08d2cbc3-2eef-4700-a505-3df21b3ea401 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:36.504801 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-08d2cbc3-2eef-4700-a505-3df21b3ea401 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1708 microversion: 2.1 time: 0.157723 Aug 06 14:34:36.505528 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 296/639] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:34:36 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1708 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:34:36.663724 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-6156075b-3c00-4e64-a6af-7d0de13ba50f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:36.673276 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-6156075b-3c00-4e64-a6af-7d0de13ba50f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:36.674761 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-6156075b-3c00-4e64-a6af-7d0de13ba50f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:36.675946 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-6156075b-3c00-4e64-a6af-7d0de13ba50f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1754 microversion: 2.20 time: 0.221087 Aug 06 14:34:36.676517 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 344/640] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:34:36 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1754 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 14:34:37.526666 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-48535f15-ef6f-415a-9457-fc1e0b4aa64b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:37.527378 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-48535f15-ef6f-415a-9457-fc1e0b4aa64b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:37.534513 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-48535f15-ef6f-415a-9457-fc1e0b4aa64b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:37.535143 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-48535f15-ef6f-415a-9457-fc1e0b4aa64b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:37.535621 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-48535f15-ef6f-415a-9457-fc1e0b4aa64b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:37.536511 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-48535f15-ef6f-415a-9457-fc1e0b4aa64b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:37.537021 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-48535f15-ef6f-415a-9457-fc1e0b4aa64b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:37.537471 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-48535f15-ef6f-415a-9457-fc1e0b4aa64b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:37.676859 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-48535f15-ef6f-415a-9457-fc1e0b4aa64b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:37.685929 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-48535f15-ef6f-415a-9457-fc1e0b4aa64b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1708 microversion: 2.1 time: 0.163474 Aug 06 14:34:37.686573 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 297/641] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:34:37 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1708 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:34:37.697967 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-f4e32537-b2f7-4c71-b5d3-c04d15f3e2a9 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:37.698576 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-f4e32537-b2f7-4c71-b5d3-c04d15f3e2a9 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:37.704899 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f4e32537-b2f7-4c71-b5d3-c04d15f3e2a9 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:37.705373 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f4e32537-b2f7-4c71-b5d3-c04d15f3e2a9 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:37.705802 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f4e32537-b2f7-4c71-b5d3-c04d15f3e2a9 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:37.706480 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f4e32537-b2f7-4c71-b5d3-c04d15f3e2a9 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:37.706955 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f4e32537-b2f7-4c71-b5d3-c04d15f3e2a9 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:37.707379 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f4e32537-b2f7-4c71-b5d3-c04d15f3e2a9 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:37.843577 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-f4e32537-b2f7-4c71-b5d3-c04d15f3e2a9 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:37.853921 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-f4e32537-b2f7-4c71-b5d3-c04d15f3e2a9 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:37.855080 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-f4e32537-b2f7-4c71-b5d3-c04d15f3e2a9 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:37.856285 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-f4e32537-b2f7-4c71-b5d3-c04d15f3e2a9 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1754 microversion: 2.20 time: 0.162150 Aug 06 14:34:37.856866 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 345/642] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:34:37 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:34:38.707303 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-dbfd8ec6-37ca-4419-bc25-d6431e05c8d1 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:38.707921 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-dbfd8ec6-37ca-4419-bc25-d6431e05c8d1 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:38.714891 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-dbfd8ec6-37ca-4419-bc25-d6431e05c8d1 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:38.715408 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-dbfd8ec6-37ca-4419-bc25-d6431e05c8d1 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:38.715828 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-dbfd8ec6-37ca-4419-bc25-d6431e05c8d1 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:38.716520 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-dbfd8ec6-37ca-4419-bc25-d6431e05c8d1 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:38.716976 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-dbfd8ec6-37ca-4419-bc25-d6431e05c8d1 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:38.717401 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-dbfd8ec6-37ca-4419-bc25-d6431e05c8d1 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:38.843859 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-dbfd8ec6-37ca-4419-bc25-d6431e05c8d1 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:38.852531 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-dbfd8ec6-37ca-4419-bc25-d6431e05c8d1 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1708 microversion: 2.1 time: 0.148947 Aug 06 14:34:38.853106 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 298/643] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:34:38 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1708 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:34:38.879741 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-95bcaeaf-3e8b-4d40-b550-0f55bb75cd08 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:38.880351 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-95bcaeaf-3e8b-4d40-b550-0f55bb75cd08 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:38.887401 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-95bcaeaf-3e8b-4d40-b550-0f55bb75cd08 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:38.887881 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-95bcaeaf-3e8b-4d40-b550-0f55bb75cd08 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:38.888312 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-95bcaeaf-3e8b-4d40-b550-0f55bb75cd08 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:38.889001 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-95bcaeaf-3e8b-4d40-b550-0f55bb75cd08 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:38.889446 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-95bcaeaf-3e8b-4d40-b550-0f55bb75cd08 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:38.889865 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-95bcaeaf-3e8b-4d40-b550-0f55bb75cd08 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:39.031212 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-95bcaeaf-3e8b-4d40-b550-0f55bb75cd08 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:39.044960 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-95bcaeaf-3e8b-4d40-b550-0f55bb75cd08 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:39.046455 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-95bcaeaf-3e8b-4d40-b550-0f55bb75cd08 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:39.047648 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-95bcaeaf-3e8b-4d40-b550-0f55bb75cd08 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1810 microversion: 2.20 time: 0.171759 Aug 06 14:34:39.048204 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 346/644] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:34:38 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1810 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:34:39.873414 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-ca5cab05-5f5d-4da7-af47-f45e10093bc5 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:39.874042 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-ca5cab05-5f5d-4da7-af47-f45e10093bc5 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:39.880401 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ca5cab05-5f5d-4da7-af47-f45e10093bc5 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:39.880871 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ca5cab05-5f5d-4da7-af47-f45e10093bc5 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:39.881294 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ca5cab05-5f5d-4da7-af47-f45e10093bc5 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:39.881965 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ca5cab05-5f5d-4da7-af47-f45e10093bc5 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:39.882410 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ca5cab05-5f5d-4da7-af47-f45e10093bc5 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:39.882825 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ca5cab05-5f5d-4da7-af47-f45e10093bc5 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:40.012779 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-ca5cab05-5f5d-4da7-af47-f45e10093bc5 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:40.020583 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-ca5cab05-5f5d-4da7-af47-f45e10093bc5 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1708 microversion: 2.1 time: 0.150950 Aug 06 14:34:40.021132 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 299/645] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:34:39 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1708 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:34:40.071235 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-1066da87-253b-455d-979a-fcc00199d16e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:40.072337 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-1066da87-253b-455d-979a-fcc00199d16e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:40.078570 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1066da87-253b-455d-979a-fcc00199d16e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:40.079116 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1066da87-253b-455d-979a-fcc00199d16e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:40.079539 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1066da87-253b-455d-979a-fcc00199d16e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:40.080212 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1066da87-253b-455d-979a-fcc00199d16e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:40.080658 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1066da87-253b-455d-979a-fcc00199d16e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:40.081069 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1066da87-253b-455d-979a-fcc00199d16e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:40.209797 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-1066da87-253b-455d-979a-fcc00199d16e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:40.219351 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-1066da87-253b-455d-979a-fcc00199d16e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:40.221103 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-1066da87-253b-455d-979a-fcc00199d16e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:40.222403 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-1066da87-253b-455d-979a-fcc00199d16e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1810 microversion: 2.20 time: 0.155051 Aug 06 14:34:40.223288 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 347/646] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:34:40 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1810 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:34:41.042405 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-b7d93589-5d44-4295-830f-585fd8955d59 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:41.042988 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-b7d93589-5d44-4295-830f-585fd8955d59 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:41.049297 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b7d93589-5d44-4295-830f-585fd8955d59 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:41.049778 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b7d93589-5d44-4295-830f-585fd8955d59 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:41.050216 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b7d93589-5d44-4295-830f-585fd8955d59 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:41.050923 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b7d93589-5d44-4295-830f-585fd8955d59 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:41.051378 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b7d93589-5d44-4295-830f-585fd8955d59 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:41.051801 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b7d93589-5d44-4295-830f-585fd8955d59 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:41.177831 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-b7d93589-5d44-4295-830f-585fd8955d59 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:41.185898 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-b7d93589-5d44-4295-830f-585fd8955d59 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1708 microversion: 2.1 time: 0.147915 Aug 06 14:34:41.186465 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 300/647] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:34:41 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1708 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:34:41.245649 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-2ab884f8-4e22-40ef-aba2-175b5a61002c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:41.246257 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-2ab884f8-4e22-40ef-aba2-175b5a61002c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:41.252818 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2ab884f8-4e22-40ef-aba2-175b5a61002c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:41.253310 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2ab884f8-4e22-40ef-aba2-175b5a61002c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:41.253742 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2ab884f8-4e22-40ef-aba2-175b5a61002c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:41.254431 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2ab884f8-4e22-40ef-aba2-175b5a61002c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:41.254903 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2ab884f8-4e22-40ef-aba2-175b5a61002c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:41.255323 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2ab884f8-4e22-40ef-aba2-175b5a61002c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:41.384505 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-2ab884f8-4e22-40ef-aba2-175b5a61002c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:41.392826 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-2ab884f8-4e22-40ef-aba2-175b5a61002c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:41.394332 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-2ab884f8-4e22-40ef-aba2-175b5a61002c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:41.395513 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-2ab884f8-4e22-40ef-aba2-175b5a61002c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1810 microversion: 2.20 time: 0.153751 Aug 06 14:34:41.396068 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 348/648] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:34:41 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1810 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:34:42.206858 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-1e6f4606-fc6a-4927-b09b-e9b1e8174367 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:42.207483 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-1e6f4606-fc6a-4927-b09b-e9b1e8174367 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:42.213327 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1e6f4606-fc6a-4927-b09b-e9b1e8174367 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:42.213804 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1e6f4606-fc6a-4927-b09b-e9b1e8174367 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:42.214237 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1e6f4606-fc6a-4927-b09b-e9b1e8174367 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:42.214932 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1e6f4606-fc6a-4927-b09b-e9b1e8174367 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:42.215384 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1e6f4606-fc6a-4927-b09b-e9b1e8174367 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:42.215798 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1e6f4606-fc6a-4927-b09b-e9b1e8174367 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:42.341740 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-1e6f4606-fc6a-4927-b09b-e9b1e8174367 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:42.349553 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-1e6f4606-fc6a-4927-b09b-e9b1e8174367 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1708 microversion: 2.1 time: 0.146674 Aug 06 14:34:42.350141 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 301/649] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:34:42 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1708 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:34:42.419186 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-f4b55717-e48b-40ba-954a-44282d49ce6a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:42.419799 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-f4b55717-e48b-40ba-954a-44282d49ce6a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:42.426062 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f4b55717-e48b-40ba-954a-44282d49ce6a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:42.426543 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f4b55717-e48b-40ba-954a-44282d49ce6a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:42.427020 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f4b55717-e48b-40ba-954a-44282d49ce6a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:42.427707 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f4b55717-e48b-40ba-954a-44282d49ce6a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:42.428157 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f4b55717-e48b-40ba-954a-44282d49ce6a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:42.428578 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f4b55717-e48b-40ba-954a-44282d49ce6a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:42.558893 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-f4b55717-e48b-40ba-954a-44282d49ce6a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:42.567203 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-f4b55717-e48b-40ba-954a-44282d49ce6a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:42.568702 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-f4b55717-e48b-40ba-954a-44282d49ce6a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:42.569846 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-f4b55717-e48b-40ba-954a-44282d49ce6a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1810 microversion: 2.20 time: 0.155003 Aug 06 14:34:42.570396 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 349/650] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:34:42 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1810 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:34:43.371453 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-9a314455-f10a-4c2f-ad9c-b79be6899ee7 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:43.371988 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-9a314455-f10a-4c2f-ad9c-b79be6899ee7 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:43.378334 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9a314455-f10a-4c2f-ad9c-b79be6899ee7 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:43.378816 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9a314455-f10a-4c2f-ad9c-b79be6899ee7 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:43.379279 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9a314455-f10a-4c2f-ad9c-b79be6899ee7 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:43.379956 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9a314455-f10a-4c2f-ad9c-b79be6899ee7 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:43.380403 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9a314455-f10a-4c2f-ad9c-b79be6899ee7 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:43.380819 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9a314455-f10a-4c2f-ad9c-b79be6899ee7 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:43.511264 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-9a314455-f10a-4c2f-ad9c-b79be6899ee7 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:43.519028 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-9a314455-f10a-4c2f-ad9c-b79be6899ee7 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1712 microversion: 2.1 time: 0.152026 Aug 06 14:34:43.519581 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 302/651] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:34:43 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1712 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:34:43.592551 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-ce048bd9-63c7-487b-9b7e-46b70959cca4 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:43.593154 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-ce048bd9-63c7-487b-9b7e-46b70959cca4 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:43.595627 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_api:SELECT=70 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:34:43.600757 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ce048bd9-63c7-487b-9b7e-46b70959cca4 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:43.601234 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ce048bd9-63c7-487b-9b7e-46b70959cca4 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:43.601679 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ce048bd9-63c7-487b-9b7e-46b70959cca4 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:43.602350 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ce048bd9-63c7-487b-9b7e-46b70959cca4 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:43.602800 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ce048bd9-63c7-487b-9b7e-46b70959cca4 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:43.603242 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ce048bd9-63c7-487b-9b7e-46b70959cca4 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:43.730254 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-ce048bd9-63c7-487b-9b7e-46b70959cca4 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:43.739897 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-ce048bd9-63c7-487b-9b7e-46b70959cca4 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:43.741395 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-ce048bd9-63c7-487b-9b7e-46b70959cca4 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:43.742549 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-ce048bd9-63c7-487b-9b7e-46b70959cca4 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1810 microversion: 2.20 time: 0.154016 Aug 06 14:34:43.743716 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 350/652] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:34:43 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1810 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:34:44.765926 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-e4767525-205a-499e-87ba-7c839a7e76eb tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:44.766522 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-e4767525-205a-499e-87ba-7c839a7e76eb tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:44.772855 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e4767525-205a-499e-87ba-7c839a7e76eb tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:44.773327 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e4767525-205a-499e-87ba-7c839a7e76eb tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:44.773751 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e4767525-205a-499e-87ba-7c839a7e76eb tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:44.774425 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e4767525-205a-499e-87ba-7c839a7e76eb tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:44.774974 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e4767525-205a-499e-87ba-7c839a7e76eb tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:44.776075 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e4767525-205a-499e-87ba-7c839a7e76eb tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:44.963190 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-e4767525-205a-499e-87ba-7c839a7e76eb tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:44.973235 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-e4767525-205a-499e-87ba-7c839a7e76eb tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:44.974944 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-e4767525-205a-499e-87ba-7c839a7e76eb tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:44.976136 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-e4767525-205a-499e-87ba-7c839a7e76eb tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1810 microversion: 2.20 time: 0.213999 Aug 06 14:34:44.976686 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 303/653] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:34:44 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1810 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:34:46.000253 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-d976e09d-283c-493d-ad68-074aa538818f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:46.000856 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-d976e09d-283c-493d-ad68-074aa538818f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:46.007385 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d976e09d-283c-493d-ad68-074aa538818f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:46.007865 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d976e09d-283c-493d-ad68-074aa538818f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:46.008295 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d976e09d-283c-493d-ad68-074aa538818f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:46.008989 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d976e09d-283c-493d-ad68-074aa538818f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:46.009435 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d976e09d-283c-493d-ad68-074aa538818f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:46.010344 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d976e09d-283c-493d-ad68-074aa538818f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:46.189485 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-d976e09d-283c-493d-ad68-074aa538818f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:46.198274 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-d976e09d-283c-493d-ad68-074aa538818f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:46.199832 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-d976e09d-283c-493d-ad68-074aa538818f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:46.200971 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-d976e09d-283c-493d-ad68-074aa538818f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1810 microversion: 2.20 time: 0.204601 Aug 06 14:34:46.201548 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 351/654] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:34:45 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1810 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:34:47.227362 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-3ce13987-cf43-4e3d-8505-2746da94fb78 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:47.227988 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-3ce13987-cf43-4e3d-8505-2746da94fb78 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:47.235107 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3ce13987-cf43-4e3d-8505-2746da94fb78 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:47.235590 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3ce13987-cf43-4e3d-8505-2746da94fb78 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:47.236020 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3ce13987-cf43-4e3d-8505-2746da94fb78 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:47.236723 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3ce13987-cf43-4e3d-8505-2746da94fb78 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:47.237192 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3ce13987-cf43-4e3d-8505-2746da94fb78 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:47.237778 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3ce13987-cf43-4e3d-8505-2746da94fb78 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:47.370255 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-3ce13987-cf43-4e3d-8505-2746da94fb78 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:47.378439 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-3ce13987-cf43-4e3d-8505-2746da94fb78 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:47.382086 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-3ce13987-cf43-4e3d-8505-2746da94fb78 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:47.382086 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-3ce13987-cf43-4e3d-8505-2746da94fb78 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1810 microversion: 2.20 time: 0.158124 Aug 06 14:34:47.382086 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 304/655] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:34:47 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:34:48.404608 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-ba0d56bc-0f8f-4c65-a49d-c239139af370 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:48.405298 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-ba0d56bc-0f8f-4c65-a49d-c239139af370 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:48.411659 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ba0d56bc-0f8f-4c65-a49d-c239139af370 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:48.412138 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ba0d56bc-0f8f-4c65-a49d-c239139af370 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:48.412570 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ba0d56bc-0f8f-4c65-a49d-c239139af370 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:48.413255 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ba0d56bc-0f8f-4c65-a49d-c239139af370 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:48.413708 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ba0d56bc-0f8f-4c65-a49d-c239139af370 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:48.414131 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ba0d56bc-0f8f-4c65-a49d-c239139af370 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:48.418588 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:34:48.542862 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-ba0d56bc-0f8f-4c65-a49d-c239139af370 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:48.551187 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-ba0d56bc-0f8f-4c65-a49d-c239139af370 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:48.552679 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-ba0d56bc-0f8f-4c65-a49d-c239139af370 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:48.553825 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-ba0d56bc-0f8f-4c65-a49d-c239139af370 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1810 microversion: 2.20 time: 0.153103 Aug 06 14:34:48.554383 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 352/656] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:34:48 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1810 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:34:49.578968 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-a62d1b20-27e0-4446-8889-b376a2f77cee tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:49.580675 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-a62d1b20-27e0-4446-8889-b376a2f77cee tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:49.587925 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a62d1b20-27e0-4446-8889-b376a2f77cee tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:49.588455 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a62d1b20-27e0-4446-8889-b376a2f77cee tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:49.589449 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a62d1b20-27e0-4446-8889-b376a2f77cee tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:49.590178 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a62d1b20-27e0-4446-8889-b376a2f77cee tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:49.590635 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a62d1b20-27e0-4446-8889-b376a2f77cee tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:49.591154 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a62d1b20-27e0-4446-8889-b376a2f77cee tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:49.731183 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-a62d1b20-27e0-4446-8889-b376a2f77cee tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:49.743474 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-a62d1b20-27e0-4446-8889-b376a2f77cee tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:49.750822 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-a62d1b20-27e0-4446-8889-b376a2f77cee tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:49.752307 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-a62d1b20-27e0-4446-8889-b376a2f77cee tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1810 microversion: 2.20 time: 0.178415 Aug 06 14:34:49.753240 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 305/657] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:34:49 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1810 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:34:50.778559 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-9733e1d5-c3f5-41f9-a3c0-71f4720a1036 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:50.779266 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-9733e1d5-c3f5-41f9-a3c0-71f4720a1036 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:50.785788 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9733e1d5-c3f5-41f9-a3c0-71f4720a1036 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:50.786262 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9733e1d5-c3f5-41f9-a3c0-71f4720a1036 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:50.786685 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9733e1d5-c3f5-41f9-a3c0-71f4720a1036 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:50.787394 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9733e1d5-c3f5-41f9-a3c0-71f4720a1036 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:50.787841 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9733e1d5-c3f5-41f9-a3c0-71f4720a1036 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:50.788257 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9733e1d5-c3f5-41f9-a3c0-71f4720a1036 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:50.918598 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-9733e1d5-c3f5-41f9-a3c0-71f4720a1036 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:50.926862 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-9733e1d5-c3f5-41f9-a3c0-71f4720a1036 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:50.928376 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-9733e1d5-c3f5-41f9-a3c0-71f4720a1036 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:50.929527 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-9733e1d5-c3f5-41f9-a3c0-71f4720a1036 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1810 microversion: 2.20 time: 0.155484 Aug 06 14:34:50.930079 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 353/658] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:34:50 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1810 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:34:51.952659 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-077e3621-46c3-4322-89b9-d2107bf90b4b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:51.953341 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-077e3621-46c3-4322-89b9-d2107bf90b4b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:51.960031 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-077e3621-46c3-4322-89b9-d2107bf90b4b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:51.960517 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-077e3621-46c3-4322-89b9-d2107bf90b4b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:51.960955 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-077e3621-46c3-4322-89b9-d2107bf90b4b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:51.961698 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-077e3621-46c3-4322-89b9-d2107bf90b4b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:51.962150 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-077e3621-46c3-4322-89b9-d2107bf90b4b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:51.962574 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-077e3621-46c3-4322-89b9-d2107bf90b4b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:51.966585 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_cell1:SELECT=100 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:34:52.096871 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-077e3621-46c3-4322-89b9-d2107bf90b4b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:52.105968 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-077e3621-46c3-4322-89b9-d2107bf90b4b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:52.107530 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-077e3621-46c3-4322-89b9-d2107bf90b4b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:52.108714 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-077e3621-46c3-4322-89b9-d2107bf90b4b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1810 microversion: 2.20 time: 0.160068 Aug 06 14:34:52.109271 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 306/659] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:34:51 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:34:53.132771 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-8e9a2530-f14c-4191-94d6-5b2cf98a80ca tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:53.133410 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-8e9a2530-f14c-4191-94d6-5b2cf98a80ca tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:53.139996 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8e9a2530-f14c-4191-94d6-5b2cf98a80ca tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:53.140705 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8e9a2530-f14c-4191-94d6-5b2cf98a80ca tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:53.141131 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8e9a2530-f14c-4191-94d6-5b2cf98a80ca tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:53.141994 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8e9a2530-f14c-4191-94d6-5b2cf98a80ca tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:53.142442 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8e9a2530-f14c-4191-94d6-5b2cf98a80ca tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:53.142861 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8e9a2530-f14c-4191-94d6-5b2cf98a80ca tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:53.285569 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-8e9a2530-f14c-4191-94d6-5b2cf98a80ca tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:53.294537 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-8e9a2530-f14c-4191-94d6-5b2cf98a80ca tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:53.296075 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-8e9a2530-f14c-4191-94d6-5b2cf98a80ca tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:53.297221 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-8e9a2530-f14c-4191-94d6-5b2cf98a80ca tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1810 microversion: 2.20 time: 0.168402 Aug 06 14:34:53.297765 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 354/660] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:34:53 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1810 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 14:34:54.320519 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-22f6e394-2aae-4b1d-a6a1-ed64b3a3c4ff tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:54.321180 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-22f6e394-2aae-4b1d-a6a1-ed64b3a3c4ff tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:54.327788 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-22f6e394-2aae-4b1d-a6a1-ed64b3a3c4ff tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:54.328274 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-22f6e394-2aae-4b1d-a6a1-ed64b3a3c4ff tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:54.328719 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-22f6e394-2aae-4b1d-a6a1-ed64b3a3c4ff tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:54.329421 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-22f6e394-2aae-4b1d-a6a1-ed64b3a3c4ff tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:54.329875 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-22f6e394-2aae-4b1d-a6a1-ed64b3a3c4ff tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:54.330300 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-22f6e394-2aae-4b1d-a6a1-ed64b3a3c4ff tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:54.496201 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-22f6e394-2aae-4b1d-a6a1-ed64b3a3c4ff tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:54.504704 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-22f6e394-2aae-4b1d-a6a1-ed64b3a3c4ff tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:54.506182 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-22f6e394-2aae-4b1d-a6a1-ed64b3a3c4ff tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:54.507344 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-22f6e394-2aae-4b1d-a6a1-ed64b3a3c4ff tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1810 microversion: 2.20 time: 0.190820 Aug 06 14:34:54.507892 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 307/661] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:34:54 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1810 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:34:55.530568 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-7074ae04-f057-4509-8a8b-fc6d1daeb35e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:55.531217 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-7074ae04-f057-4509-8a8b-fc6d1daeb35e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:55.537435 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7074ae04-f057-4509-8a8b-fc6d1daeb35e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:55.537941 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7074ae04-f057-4509-8a8b-fc6d1daeb35e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:55.538373 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7074ae04-f057-4509-8a8b-fc6d1daeb35e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:55.539136 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7074ae04-f057-4509-8a8b-fc6d1daeb35e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:55.539543 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7074ae04-f057-4509-8a8b-fc6d1daeb35e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:55.539961 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7074ae04-f057-4509-8a8b-fc6d1daeb35e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:55.687581 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-7074ae04-f057-4509-8a8b-fc6d1daeb35e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:55.696605 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-7074ae04-f057-4509-8a8b-fc6d1daeb35e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:55.698604 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-7074ae04-f057-4509-8a8b-fc6d1daeb35e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:55.699806 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-7074ae04-f057-4509-8a8b-fc6d1daeb35e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1810 microversion: 2.20 time: 0.173801 Aug 06 14:34:55.700358 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 355/662] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:34:55 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1810 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:34:56.129988 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-82d59d5c-8844-4cbc-8a52-05255ca55542 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:56.130537 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-82d59d5c-8844-4cbc-8a52-05255ca55542 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] [instance: d30e3f96-04e3-4a5a-b38b-5fdf3be21595] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:56.137605 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-82d59d5c-8844-4cbc-8a52-05255ca55542 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:56.138088 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-82d59d5c-8844-4cbc-8a52-05255ca55542 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:56.138606 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-82d59d5c-8844-4cbc-8a52-05255ca55542 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:56.139251 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-82d59d5c-8844-4cbc-8a52-05255ca55542 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:56.139716 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-82d59d5c-8844-4cbc-8a52-05255ca55542 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:56.140140 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-82d59d5c-8844-4cbc-8a52-05255ca55542 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:56.222965 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.objects.instance [None req-82d59d5c-8844-4cbc-8a52-05255ca55542 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lazy-loading 'services' on Instance uuid d30e3f96-04e3-4a5a-b38b-5fdf3be21595 {{(pid=117838) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 14:34:56.296416 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-82d59d5c-8844-4cbc-8a52-05255ca55542 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d30e3f96-04e3-4a5a-b38b-5fdf3be21595/os-volume_attachments/061a7745-4bbc-4ae1-911c-cbbb10fffe85" status: 202 len: 0 microversion: 2.1 time: 0.170134 Aug 06 14:34:56.297051 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 308/663] 10.222.0.17 () {58 vars in 1416 bytes} [Sat Aug 6 14:34:56 2022] DELETE /compute/v2.1/servers/d30e3f96-04e3-4a5a-b38b-5fdf3be21595/os-volume_attachments/061a7745-4bbc-4ae1-911c-cbbb10fffe85 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 14:34:56.724535 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-34ab6319-8a76-48ef-b87e-998254895b85 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:56.735102 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-34ab6319-8a76-48ef-b87e-998254895b85 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:56.742122 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-34ab6319-8a76-48ef-b87e-998254895b85 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:56.742619 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-34ab6319-8a76-48ef-b87e-998254895b85 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:56.743094 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-34ab6319-8a76-48ef-b87e-998254895b85 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:56.743800 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-34ab6319-8a76-48ef-b87e-998254895b85 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:56.744250 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-34ab6319-8a76-48ef-b87e-998254895b85 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:56.744668 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-34ab6319-8a76-48ef-b87e-998254895b85 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:56.890102 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-34ab6319-8a76-48ef-b87e-998254895b85 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:56.898805 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-34ab6319-8a76-48ef-b87e-998254895b85 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:56.900310 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-34ab6319-8a76-48ef-b87e-998254895b85 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:56.901445 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-34ab6319-8a76-48ef-b87e-998254895b85 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1810 microversion: 2.20 time: 0.181504 Aug 06 14:34:56.902001 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 356/664] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:34:56 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1810 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:34:57.924628 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-f7646f3b-3158-4340-88cf-15e67710dcd7 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:57.925407 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-f7646f3b-3158-4340-88cf-15e67710dcd7 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:57.933379 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f7646f3b-3158-4340-88cf-15e67710dcd7 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:57.933861 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f7646f3b-3158-4340-88cf-15e67710dcd7 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:57.934470 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f7646f3b-3158-4340-88cf-15e67710dcd7 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:57.935194 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f7646f3b-3158-4340-88cf-15e67710dcd7 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:57.935645 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f7646f3b-3158-4340-88cf-15e67710dcd7 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:57.936064 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f7646f3b-3158-4340-88cf-15e67710dcd7 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:58.115104 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-f7646f3b-3158-4340-88cf-15e67710dcd7 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:58.125846 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-f7646f3b-3158-4340-88cf-15e67710dcd7 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:58.127632 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-f7646f3b-3158-4340-88cf-15e67710dcd7 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:58.128828 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-f7646f3b-3158-4340-88cf-15e67710dcd7 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1810 microversion: 2.20 time: 0.208492 Aug 06 14:34:58.129373 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 309/665] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:34:57 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1810 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:34:59.154433 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-1dcc3348-446d-4efc-810f-4d412198f2ce tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:34:59.155630 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-1dcc3348-446d-4efc-810f-4d412198f2ce tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:34:59.161939 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1dcc3348-446d-4efc-810f-4d412198f2ce tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:59.162431 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1dcc3348-446d-4efc-810f-4d412198f2ce tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:59.162884 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1dcc3348-446d-4efc-810f-4d412198f2ce tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:59.163587 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1dcc3348-446d-4efc-810f-4d412198f2ce tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:34:59.164042 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1dcc3348-446d-4efc-810f-4d412198f2ce tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:34:59.164462 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1dcc3348-446d-4efc-810f-4d412198f2ce tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:34:59.354919 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-1dcc3348-446d-4efc-810f-4d412198f2ce tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:59.366013 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-1dcc3348-446d-4efc-810f-4d412198f2ce tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:59.367563 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-1dcc3348-446d-4efc-810f-4d412198f2ce tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:34:59.369015 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-1dcc3348-446d-4efc-810f-4d412198f2ce tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1810 microversion: 2.20 time: 0.219135 Aug 06 14:34:59.371560 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 357/666] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:34:59 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1810 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:35:00.393919 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-567ca202-05e7-4efe-9c54-06e6b5ffa68c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:35:00.394604 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-567ca202-05e7-4efe-9c54-06e6b5ffa68c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:35:00.400941 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-567ca202-05e7-4efe-9c54-06e6b5ffa68c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:00.401411 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-567ca202-05e7-4efe-9c54-06e6b5ffa68c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:00.401921 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-567ca202-05e7-4efe-9c54-06e6b5ffa68c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:00.402590 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-567ca202-05e7-4efe-9c54-06e6b5ffa68c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:00.403081 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-567ca202-05e7-4efe-9c54-06e6b5ffa68c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:00.403496 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-567ca202-05e7-4efe-9c54-06e6b5ffa68c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:00.543370 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-567ca202-05e7-4efe-9c54-06e6b5ffa68c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:00.552100 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-567ca202-05e7-4efe-9c54-06e6b5ffa68c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:00.554250 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-567ca202-05e7-4efe-9c54-06e6b5ffa68c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:00.555983 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-567ca202-05e7-4efe-9c54-06e6b5ffa68c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1810 microversion: 2.20 time: 0.165967 Aug 06 14:35:00.556908 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 310/667] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:35:00 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1810 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:35:01.581328 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-2672986d-740e-4c1a-a7d7-0704a3617fe7 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:35:01.582015 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-2672986d-740e-4c1a-a7d7-0704a3617fe7 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:35:01.588090 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2672986d-740e-4c1a-a7d7-0704a3617fe7 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:01.589088 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2672986d-740e-4c1a-a7d7-0704a3617fe7 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:01.589523 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2672986d-740e-4c1a-a7d7-0704a3617fe7 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:01.590212 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2672986d-740e-4c1a-a7d7-0704a3617fe7 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:01.590662 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2672986d-740e-4c1a-a7d7-0704a3617fe7 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:01.591106 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2672986d-740e-4c1a-a7d7-0704a3617fe7 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:01.751680 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-2672986d-740e-4c1a-a7d7-0704a3617fe7 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:01.761215 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-2672986d-740e-4c1a-a7d7-0704a3617fe7 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:01.762949 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-2672986d-740e-4c1a-a7d7-0704a3617fe7 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:01.764197 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-2672986d-740e-4c1a-a7d7-0704a3617fe7 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1810 microversion: 2.20 time: 0.186845 Aug 06 14:35:01.764874 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 358/668] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:35:01 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1810 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:35:02.963816 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-2a9482e8-f7ca-489a-b3ef-963d4a99abca tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:35:02.964450 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-2a9482e8-f7ca-489a-b3ef-963d4a99abca tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:35:02.966380 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_api:SELECT=40 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:35:02.971605 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2a9482e8-f7ca-489a-b3ef-963d4a99abca tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:02.972084 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2a9482e8-f7ca-489a-b3ef-963d4a99abca tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:02.972512 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2a9482e8-f7ca-489a-b3ef-963d4a99abca tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:02.973203 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2a9482e8-f7ca-489a-b3ef-963d4a99abca tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:02.973649 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2a9482e8-f7ca-489a-b3ef-963d4a99abca tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:02.974066 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2a9482e8-f7ca-489a-b3ef-963d4a99abca tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:03.108524 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-2a9482e8-f7ca-489a-b3ef-963d4a99abca tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:03.116782 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-2a9482e8-f7ca-489a-b3ef-963d4a99abca tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:03.118258 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-2a9482e8-f7ca-489a-b3ef-963d4a99abca tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:03.119427 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-2a9482e8-f7ca-489a-b3ef-963d4a99abca tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1810 microversion: 2.20 time: 0.336166 Aug 06 14:35:03.120037 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 311/669] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:35:02 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1810 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:35:03.155565 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 14:35:03.156074 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Sat Aug 6 14:35:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 14:35:04.143385 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-3cfa8cda-bff9-44bf-9221-f0897e17b331 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:35:04.143990 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-3cfa8cda-bff9-44bf-9221-f0897e17b331 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:35:04.150365 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-3cfa8cda-bff9-44bf-9221-f0897e17b331 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:04.150836 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-3cfa8cda-bff9-44bf-9221-f0897e17b331 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:04.151295 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-3cfa8cda-bff9-44bf-9221-f0897e17b331 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:04.151973 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-3cfa8cda-bff9-44bf-9221-f0897e17b331 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:04.152424 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-3cfa8cda-bff9-44bf-9221-f0897e17b331 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:04.152841 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-3cfa8cda-bff9-44bf-9221-f0897e17b331 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:04.279414 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-3cfa8cda-bff9-44bf-9221-f0897e17b331 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:04.287599 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-3cfa8cda-bff9-44bf-9221-f0897e17b331 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:04.289078 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-3cfa8cda-bff9-44bf-9221-f0897e17b331 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:04.290214 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-3cfa8cda-bff9-44bf-9221-f0897e17b331 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1810 microversion: 2.20 time: 0.150740 Aug 06 14:35:04.290761 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 359/670] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:35:04 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1810 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:35:05.313482 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-8f00d722-c708-4134-a64e-b9b125290dbc tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:35:05.314088 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-8f00d722-c708-4134-a64e-b9b125290dbc tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:35:05.320601 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8f00d722-c708-4134-a64e-b9b125290dbc tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:05.321079 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8f00d722-c708-4134-a64e-b9b125290dbc tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:05.321514 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8f00d722-c708-4134-a64e-b9b125290dbc tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:05.322193 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8f00d722-c708-4134-a64e-b9b125290dbc tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:05.322643 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8f00d722-c708-4134-a64e-b9b125290dbc tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:05.323145 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8f00d722-c708-4134-a64e-b9b125290dbc tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:05.451258 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-8f00d722-c708-4134-a64e-b9b125290dbc tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:05.459598 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-8f00d722-c708-4134-a64e-b9b125290dbc tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:05.461089 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-8f00d722-c708-4134-a64e-b9b125290dbc tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:05.462239 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-8f00d722-c708-4134-a64e-b9b125290dbc tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1810 microversion: 2.20 time: 0.152668 Aug 06 14:35:05.462784 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 312/671] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:35:05 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1810 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:35:06.485994 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-44f803ce-9f50-4e25-ac2b-7c9bb449f27f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:35:06.486527 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-44f803ce-9f50-4e25-ac2b-7c9bb449f27f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:35:06.492981 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-44f803ce-9f50-4e25-ac2b-7c9bb449f27f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:06.493457 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-44f803ce-9f50-4e25-ac2b-7c9bb449f27f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:06.493888 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-44f803ce-9f50-4e25-ac2b-7c9bb449f27f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:06.495201 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-44f803ce-9f50-4e25-ac2b-7c9bb449f27f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:06.495655 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-44f803ce-9f50-4e25-ac2b-7c9bb449f27f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:06.496079 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-44f803ce-9f50-4e25-ac2b-7c9bb449f27f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:06.624258 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-44f803ce-9f50-4e25-ac2b-7c9bb449f27f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:06.632473 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-44f803ce-9f50-4e25-ac2b-7c9bb449f27f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:06.633959 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-44f803ce-9f50-4e25-ac2b-7c9bb449f27f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:06.635126 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-44f803ce-9f50-4e25-ac2b-7c9bb449f27f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1810 microversion: 2.20 time: 0.153053 Aug 06 14:35:06.635675 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 360/672] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:35:06 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1810 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:35:07.657503 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-f6c8cd75-3bd0-4d6e-8607-4980afb67d10 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:35:07.658138 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-f6c8cd75-3bd0-4d6e-8607-4980afb67d10 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:35:07.664604 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f6c8cd75-3bd0-4d6e-8607-4980afb67d10 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:07.665085 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f6c8cd75-3bd0-4d6e-8607-4980afb67d10 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:07.665517 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f6c8cd75-3bd0-4d6e-8607-4980afb67d10 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:07.666199 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f6c8cd75-3bd0-4d6e-8607-4980afb67d10 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:07.667224 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f6c8cd75-3bd0-4d6e-8607-4980afb67d10 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:07.667647 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f6c8cd75-3bd0-4d6e-8607-4980afb67d10 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:07.792932 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-f6c8cd75-3bd0-4d6e-8607-4980afb67d10 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:07.801220 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-f6c8cd75-3bd0-4d6e-8607-4980afb67d10 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:07.802733 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-f6c8cd75-3bd0-4d6e-8607-4980afb67d10 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:07.803903 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-f6c8cd75-3bd0-4d6e-8607-4980afb67d10 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1810 microversion: 2.20 time: 0.150289 Aug 06 14:35:07.804471 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 313/673] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:35:07 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1810 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:35:08.827455 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-38b5d159-1509-43b3-ba03-1d047d241ace tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:35:08.828058 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-38b5d159-1509-43b3-ba03-1d047d241ace tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:35:08.834313 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-38b5d159-1509-43b3-ba03-1d047d241ace tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:08.834790 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-38b5d159-1509-43b3-ba03-1d047d241ace tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:08.835260 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-38b5d159-1509-43b3-ba03-1d047d241ace tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:08.835942 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-38b5d159-1509-43b3-ba03-1d047d241ace tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:08.836392 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-38b5d159-1509-43b3-ba03-1d047d241ace tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:08.836810 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-38b5d159-1509-43b3-ba03-1d047d241ace tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:08.970441 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-38b5d159-1509-43b3-ba03-1d047d241ace tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:08.978623 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-38b5d159-1509-43b3-ba03-1d047d241ace tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:08.980181 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-38b5d159-1509-43b3-ba03-1d047d241ace tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:08.981339 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-38b5d159-1509-43b3-ba03-1d047d241ace tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1810 microversion: 2.20 time: 0.158357 Aug 06 14:35:08.981882 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 361/674] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:35:08 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:35:10.004614 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-2c5933d3-b19f-4aa0-8c87-f8b246ed5508 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:35:10.005166 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-2c5933d3-b19f-4aa0-8c87-f8b246ed5508 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:35:10.011539 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2c5933d3-b19f-4aa0-8c87-f8b246ed5508 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:10.012011 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2c5933d3-b19f-4aa0-8c87-f8b246ed5508 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:10.012437 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2c5933d3-b19f-4aa0-8c87-f8b246ed5508 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:10.013116 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2c5933d3-b19f-4aa0-8c87-f8b246ed5508 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:10.013560 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2c5933d3-b19f-4aa0-8c87-f8b246ed5508 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:10.013982 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2c5933d3-b19f-4aa0-8c87-f8b246ed5508 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:10.134934 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-4eefbb84-2c5e-471c-9728-c42a3fa78f44 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:35:10.135471 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-4eefbb84-2c5e-471c-9728-c42a3fa78f44 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] [instance: d30e3f96-04e3-4a5a-b38b-5fdf3be21595] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:35:10.141711 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-4eefbb84-2c5e-471c-9728-c42a3fa78f44 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:10.142195 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-4eefbb84-2c5e-471c-9728-c42a3fa78f44 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:10.142632 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-4eefbb84-2c5e-471c-9728-c42a3fa78f44 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:10.143359 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-4eefbb84-2c5e-471c-9728-c42a3fa78f44 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:10.143816 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-4eefbb84-2c5e-471c-9728-c42a3fa78f44 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:10.144239 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-4eefbb84-2c5e-471c-9728-c42a3fa78f44 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:10.153141 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-2c5933d3-b19f-4aa0-8c87-f8b246ed5508 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:10.161854 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-2c5933d3-b19f-4aa0-8c87-f8b246ed5508 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:10.162920 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-2c5933d3-b19f-4aa0-8c87-f8b246ed5508 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:10.164087 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-2c5933d3-b19f-4aa0-8c87-f8b246ed5508 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1810 microversion: 2.20 time: 0.163480 Aug 06 14:35:10.164647 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 314/675] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:35:09 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1810 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:35:10.169098 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-4eefbb84-2c5e-471c-9728-c42a3fa78f44 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] [instance: d30e3f96-04e3-4a5a-b38b-5fdf3be21595] Going to try to terminate instance {{(pid=117837) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 14:35:10.245467 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-4eefbb84-2c5e-471c-9728-c42a3fa78f44 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d30e3f96-04e3-4a5a-b38b-5fdf3be21595" status: 204 len: 0 microversion: 2.1 time: 0.113918 Aug 06 14:35:10.246115 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 362/676] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Aug 6 14:35:10 2022] DELETE /compute/v2.1/servers/d30e3f96-04e3-4a5a-b38b-5fdf3be21595 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 06 14:35:10.253972 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-61d72dcf-adb2-49c5-bb4d-763d29d87e68 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:35:10.254579 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-61d72dcf-adb2-49c5-bb4d-763d29d87e68 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] [instance: d30e3f96-04e3-4a5a-b38b-5fdf3be21595] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:35:10.260340 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-61d72dcf-adb2-49c5-bb4d-763d29d87e68 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:10.260787 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-61d72dcf-adb2-49c5-bb4d-763d29d87e68 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:10.261232 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-61d72dcf-adb2-49c5-bb4d-763d29d87e68 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:10.261915 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-61d72dcf-adb2-49c5-bb4d-763d29d87e68 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:10.262367 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-61d72dcf-adb2-49c5-bb4d-763d29d87e68 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:10.262800 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-61d72dcf-adb2-49c5-bb4d-763d29d87e68 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:10.408925 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-61d72dcf-adb2-49c5-bb4d-763d29d87e68 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6f411ed91946eba54e46799edb12d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e7a9fef10f4aba994347a5d714f17f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:10.415863 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-61d72dcf-adb2-49c5-bb4d-763d29d87e68 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] 10.222.0.17 "GET /compute/v2.1/servers/d30e3f96-04e3-4a5a-b38b-5fdf3be21595" status: 200 len: 1511 microversion: 2.1 time: 0.165564 Aug 06 14:35:10.416422 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 315/677] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:35:10 2022] GET /compute/v2.1/servers/d30e3f96-04e3-4a5a-b38b-5fdf3be21595 => generated 1511 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:35:11.189144 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-c060a53d-7ad8-4ace-9b80-aab0151621b4 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:35:11.189846 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-c060a53d-7ad8-4ace-9b80-aab0151621b4 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:35:11.196675 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c060a53d-7ad8-4ace-9b80-aab0151621b4 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:11.197163 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c060a53d-7ad8-4ace-9b80-aab0151621b4 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:11.197594 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c060a53d-7ad8-4ace-9b80-aab0151621b4 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:11.198301 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c060a53d-7ad8-4ace-9b80-aab0151621b4 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:11.199308 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c060a53d-7ad8-4ace-9b80-aab0151621b4 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:11.199728 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c060a53d-7ad8-4ace-9b80-aab0151621b4 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:11.343294 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-c060a53d-7ad8-4ace-9b80-aab0151621b4 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:11.352198 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-c060a53d-7ad8-4ace-9b80-aab0151621b4 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:11.353613 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-c060a53d-7ad8-4ace-9b80-aab0151621b4 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:11.355291 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-c060a53d-7ad8-4ace-9b80-aab0151621b4 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1810 microversion: 2.20 time: 0.170159 Aug 06 14:35:11.355846 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 363/678] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:35:11 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1810 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:35:11.439884 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-76c0e125-b577-495f-8411-9e4029a585ad tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:35:11.440523 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-76c0e125-b577-495f-8411-9e4029a585ad tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] [instance: d30e3f96-04e3-4a5a-b38b-5fdf3be21595] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:35:11.446604 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-76c0e125-b577-495f-8411-9e4029a585ad tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:11.447185 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-76c0e125-b577-495f-8411-9e4029a585ad tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:11.447618 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-76c0e125-b577-495f-8411-9e4029a585ad tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:11.448297 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-76c0e125-b577-495f-8411-9e4029a585ad tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:11.448751 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-76c0e125-b577-495f-8411-9e4029a585ad tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:11.449175 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-76c0e125-b577-495f-8411-9e4029a585ad tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:11.577810 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-76c0e125-b577-495f-8411-9e4029a585ad tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6f411ed91946eba54e46799edb12d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e7a9fef10f4aba994347a5d714f17f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:11.585274 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-76c0e125-b577-495f-8411-9e4029a585ad tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] 10.222.0.17 "GET /compute/v2.1/servers/d30e3f96-04e3-4a5a-b38b-5fdf3be21595" status: 200 len: 1511 microversion: 2.1 time: 0.149194 Aug 06 14:35:11.585823 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 316/679] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:35:11 2022] GET /compute/v2.1/servers/d30e3f96-04e3-4a5a-b38b-5fdf3be21595 => generated 1511 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:35:12.379029 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-00b6c7aa-8018-435a-a4a8-fc805701a953 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:35:12.379631 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-00b6c7aa-8018-435a-a4a8-fc805701a953 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:35:12.386495 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-00b6c7aa-8018-435a-a4a8-fc805701a953 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:12.387001 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-00b6c7aa-8018-435a-a4a8-fc805701a953 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:12.387428 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-00b6c7aa-8018-435a-a4a8-fc805701a953 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:12.388100 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-00b6c7aa-8018-435a-a4a8-fc805701a953 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:12.388545 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-00b6c7aa-8018-435a-a4a8-fc805701a953 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:12.388962 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-00b6c7aa-8018-435a-a4a8-fc805701a953 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:12.517570 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-00b6c7aa-8018-435a-a4a8-fc805701a953 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:12.525762 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-00b6c7aa-8018-435a-a4a8-fc805701a953 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:12.527270 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-00b6c7aa-8018-435a-a4a8-fc805701a953 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:12.528409 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-00b6c7aa-8018-435a-a4a8-fc805701a953 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1810 microversion: 2.20 time: 0.153367 Aug 06 14:35:12.528951 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 364/680] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:35:12 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1810 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:35:12.605465 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-cbd77e11-c319-4936-80f3-1de67406eadf tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:35:12.606066 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-cbd77e11-c319-4936-80f3-1de67406eadf tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] [instance: d30e3f96-04e3-4a5a-b38b-5fdf3be21595] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:35:12.612658 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-cbd77e11-c319-4936-80f3-1de67406eadf tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:12.613132 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-cbd77e11-c319-4936-80f3-1de67406eadf tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:12.613554 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-cbd77e11-c319-4936-80f3-1de67406eadf tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:12.614228 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-cbd77e11-c319-4936-80f3-1de67406eadf tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:12.614672 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-cbd77e11-c319-4936-80f3-1de67406eadf tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:12.615112 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-cbd77e11-c319-4936-80f3-1de67406eadf tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:12.743901 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-cbd77e11-c319-4936-80f3-1de67406eadf tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6f411ed91946eba54e46799edb12d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e7a9fef10f4aba994347a5d714f17f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:12.751793 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-cbd77e11-c319-4936-80f3-1de67406eadf tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] 10.222.0.17 "GET /compute/v2.1/servers/d30e3f96-04e3-4a5a-b38b-5fdf3be21595" status: 200 len: 1511 microversion: 2.1 time: 0.150085 Aug 06 14:35:12.752354 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 317/681] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:35:12 2022] GET /compute/v2.1/servers/d30e3f96-04e3-4a5a-b38b-5fdf3be21595 => generated 1511 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:35:13.466556 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [req-1822d434-ff33-412b-8434-b53aab1010a0 req-143c358b-1b9d-473e-bbe9-ba1bb78773c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d30e3f96-04e3-4a5a-b38b-5fdf3be21595", "name": "network-vif-deleted", "tag": "0828391c-6aa9-43b3-956d-fcbcc522c19b"}]} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:35:13.476059 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-1822d434-ff33-412b-8434-b53aab1010a0 req-143c358b-1b9d-473e-bbe9-ba1bb78773c5 service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:13.476475 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-1822d434-ff33-412b-8434-b53aab1010a0 req-143c358b-1b9d-473e-bbe9-ba1bb78773c5 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:13.476907 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-1822d434-ff33-412b-8434-b53aab1010a0 req-143c358b-1b9d-473e-bbe9-ba1bb78773c5 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:13.487877 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.compute.server_external_events [req-1822d434-ff33-412b-8434-b53aab1010a0 req-143c358b-1b9d-473e-bbe9-ba1bb78773c5 service nova] Creating event network-vif-deleted:0828391c-6aa9-43b3-956d-fcbcc522c19b for instance d30e3f96-04e3-4a5a-b38b-5fdf3be21595 on hv-cinder-85199 Aug 06 14:35:13.492469 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [req-1822d434-ff33-412b-8434-b53aab1010a0 req-143c358b-1b9d-473e-bbe9-ba1bb78773c5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.215994 Aug 06 14:35:13.493034 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 365/682] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:35:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:35:13.551083 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-8856b98e-3195-4d52-a859-aa59cecffd87 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:35:13.551689 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-8856b98e-3195-4d52-a859-aa59cecffd87 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:35:13.557809 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8856b98e-3195-4d52-a859-aa59cecffd87 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:13.558288 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8856b98e-3195-4d52-a859-aa59cecffd87 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:13.558719 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8856b98e-3195-4d52-a859-aa59cecffd87 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:13.559430 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8856b98e-3195-4d52-a859-aa59cecffd87 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:13.559883 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8856b98e-3195-4d52-a859-aa59cecffd87 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:13.560308 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8856b98e-3195-4d52-a859-aa59cecffd87 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:13.689389 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-8856b98e-3195-4d52-a859-aa59cecffd87 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:13.697945 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-8856b98e-3195-4d52-a859-aa59cecffd87 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:13.700080 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-8856b98e-3195-4d52-a859-aa59cecffd87 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:13.701234 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-8856b98e-3195-4d52-a859-aa59cecffd87 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1810 microversion: 2.20 time: 0.154103 Aug 06 14:35:13.703793 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 318/683] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:35:13 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1810 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 14:35:13.773569 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-83838178-6885-4145-9497-bd9497a06f99 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:35:13.774185 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-83838178-6885-4145-9497-bd9497a06f99 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] [instance: d30e3f96-04e3-4a5a-b38b-5fdf3be21595] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:35:13.776127 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:35:13.782158 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-83838178-6885-4145-9497-bd9497a06f99 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:13.782631 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-83838178-6885-4145-9497-bd9497a06f99 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:13.783156 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-83838178-6885-4145-9497-bd9497a06f99 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:13.783836 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-83838178-6885-4145-9497-bd9497a06f99 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:13.784285 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-83838178-6885-4145-9497-bd9497a06f99 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:13.784701 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-83838178-6885-4145-9497-bd9497a06f99 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:13.819726 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-83838178-6885-4145-9497-bd9497a06f99 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:13.820199 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-83838178-6885-4145-9497-bd9497a06f99 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:13.820623 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-83838178-6885-4145-9497-bd9497a06f99 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:13.821060 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.objects.instance [None req-83838178-6885-4145-9497-bd9497a06f99 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lazy-loading 'fault' on Instance uuid d30e3f96-04e3-4a5a-b38b-5fdf3be21595 {{(pid=117837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 14:35:13.863734 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-83838178-6885-4145-9497-bd9497a06f99 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6f411ed91946eba54e46799edb12d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e7a9fef10f4aba994347a5d714f17f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:13.871286 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-83838178-6885-4145-9497-bd9497a06f99 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] 10.222.0.17 "GET /compute/v2.1/servers/d30e3f96-04e3-4a5a-b38b-5fdf3be21595" status: 200 len: 1308 microversion: 2.1 time: 0.101964 Aug 06 14:35:13.871880 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 366/684] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:35:13 2022] GET /compute/v2.1/servers/d30e3f96-04e3-4a5a-b38b-5fdf3be21595 => generated 1308 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:35:14.725960 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-2612909f-c2cd-48fd-a88c-84c10c13f69e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:35:14.726566 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-2612909f-c2cd-48fd-a88c-84c10c13f69e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:35:14.733650 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2612909f-c2cd-48fd-a88c-84c10c13f69e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:14.734128 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2612909f-c2cd-48fd-a88c-84c10c13f69e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:14.734562 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2612909f-c2cd-48fd-a88c-84c10c13f69e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:14.735266 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2612909f-c2cd-48fd-a88c-84c10c13f69e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:14.735717 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2612909f-c2cd-48fd-a88c-84c10c13f69e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:14.736136 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2612909f-c2cd-48fd-a88c-84c10c13f69e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:14.864016 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-2612909f-c2cd-48fd-a88c-84c10c13f69e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:14.872422 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-2612909f-c2cd-48fd-a88c-84c10c13f69e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:14.873921 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-2612909f-c2cd-48fd-a88c-84c10c13f69e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:14.875090 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-2612909f-c2cd-48fd-a88c-84c10c13f69e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1810 microversion: 2.20 time: 0.152991 Aug 06 14:35:14.875655 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 319/685] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:35:14 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1810 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:35:14.891855 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-7799dc30-0ca1-41a9-a5d4-239765f09b51 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:35:14.892530 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-7799dc30-0ca1-41a9-a5d4-239765f09b51 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] [instance: d30e3f96-04e3-4a5a-b38b-5fdf3be21595] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:35:14.898797 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7799dc30-0ca1-41a9-a5d4-239765f09b51 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:14.899307 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7799dc30-0ca1-41a9-a5d4-239765f09b51 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:14.899734 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7799dc30-0ca1-41a9-a5d4-239765f09b51 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:14.900405 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7799dc30-0ca1-41a9-a5d4-239765f09b51 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:14.901134 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7799dc30-0ca1-41a9-a5d4-239765f09b51 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:14.902044 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7799dc30-0ca1-41a9-a5d4-239765f09b51 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:14.920296 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:35:14.935404 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7799dc30-0ca1-41a9-a5d4-239765f09b51 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:14.935874 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7799dc30-0ca1-41a9-a5d4-239765f09b51 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:14.936303 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7799dc30-0ca1-41a9-a5d4-239765f09b51 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:14.936750 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.objects.instance [None req-7799dc30-0ca1-41a9-a5d4-239765f09b51 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lazy-loading 'fault' on Instance uuid d30e3f96-04e3-4a5a-b38b-5fdf3be21595 {{(pid=117837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 14:35:14.978168 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-7799dc30-0ca1-41a9-a5d4-239765f09b51 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb6f411ed91946eba54e46799edb12d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59e7a9fef10f4aba994347a5d714f17f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:14.986170 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-7799dc30-0ca1-41a9-a5d4-239765f09b51 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] 10.222.0.17 "GET /compute/v2.1/servers/d30e3f96-04e3-4a5a-b38b-5fdf3be21595" status: 200 len: 1308 microversion: 2.1 time: 0.098126 Aug 06 14:35:14.986717 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 367/686] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:35:14 2022] GET /compute/v2.1/servers/d30e3f96-04e3-4a5a-b38b-5fdf3be21595 => generated 1308 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:35:15.897666 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-d3b15c3f-36e3-4646-9356-dae77fb930ce tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:35:15.898268 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-d3b15c3f-36e3-4646-9356-dae77fb930ce tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:35:15.905661 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d3b15c3f-36e3-4646-9356-dae77fb930ce tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:15.906144 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d3b15c3f-36e3-4646-9356-dae77fb930ce tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:15.906575 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d3b15c3f-36e3-4646-9356-dae77fb930ce tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:15.907285 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d3b15c3f-36e3-4646-9356-dae77fb930ce tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:15.907857 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d3b15c3f-36e3-4646-9356-dae77fb930ce tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:15.908309 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d3b15c3f-36e3-4646-9356-dae77fb930ce tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:16.006526 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-c9e6a2b5-7677-491b-af88-72d8c31f92f7 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:35:16.007752 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-c9e6a2b5-7677-491b-af88-72d8c31f92f7 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] [instance: d30e3f96-04e3-4a5a-b38b-5fdf3be21595] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:35:16.014773 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c9e6a2b5-7677-491b-af88-72d8c31f92f7 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:16.015554 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c9e6a2b5-7677-491b-af88-72d8c31f92f7 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:16.015984 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c9e6a2b5-7677-491b-af88-72d8c31f92f7 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:16.016843 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c9e6a2b5-7677-491b-af88-72d8c31f92f7 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:16.017446 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c9e6a2b5-7677-491b-af88-72d8c31f92f7 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:16.018021 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c9e6a2b5-7677-491b-af88-72d8c31f92f7 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:16.031452 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.wsgi [None req-c9e6a2b5-7677-491b-af88-72d8c31f92f7 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] HTTP exception thrown: Instance d30e3f96-04e3-4a5a-b38b-5fdf3be21595 could not be found. Aug 06 14:35:16.033093 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-c9e6a2b5-7677-491b-af88-72d8c31f92f7 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Request method failure captured: Aug 06 14:35:16.033093 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: request: GET /compute/v2.1/servers/d30e3f96-04e3-4a5a-b38b-5fdf3be21595 HTTP/1.1 Aug 06 14:35:16.033093 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Accept: application/json Aug 06 14:35:16.033093 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Accept-Encoding: identity Aug 06 14:35:16.033093 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Connection: close Aug 06 14:35:16.033093 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Content-Length: 0 Aug 06 14:35:16.033093 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Content-Type: application/json Aug 06 14:35:16.033093 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Host: 10.222.0.17 Aug 06 14:35:16.033093 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Openstack-System-Scope: None Aug 06 14:35:16.033093 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: User-Agent: python-urllib3/1.26.11 Aug 06 14:35:16.033093 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Auth-Token: gAAAAABi7ntHfybhdLqD_MfQ5VIlrZZ2gnWk4LJDCQL1qmT9tDp7MeKkqfM-l89NZRj-buc66p-KyuWHFHQw7Zxxa6JW05QABm75MyL0fAyEtuFx3M5aSgeE7loE4Y6TyRy4L5jhVvtaGt6G_UlZWRwZPkkoG0ACuW2oMXwRTkQbTyaDpf_6CM4 Aug 06 14:35:16.033093 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Domain-Id: None Aug 06 14:35:16.033093 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Domain-Name: None Aug 06 14:35:16.033093 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Identity-Status: Confirmed Aug 06 14:35:16.033093 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Is-Admin-Project: True Aug 06 14:35:16.033093 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Domain-Id: default Aug 06 14:35:16.033093 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Domain-Name: Default Aug 06 14:35:16.033093 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Id: 59e7a9fef10f4aba994347a5d714f17f Aug 06 14:35:16.033093 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1131716616 Aug 06 14:35:16.033093 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Role: member,reader Aug 06 14:35:16.033093 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Roles: member,reader Aug 06 14:35:16.034648 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/59e7a9fef10f4aba994347a5d714f17f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/59e7a9fef10f4aba994347a5d714f17f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_59e7a9fef10f4aba994347a5d714f17f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/59e7a9fef10f4aba994347a5d714f17f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 06 14:35:16.034648 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant: tempest-VolumesSnapshotTestJSON-1131716616 Aug 06 14:35:16.034648 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant-Id: 59e7a9fef10f4aba994347a5d714f17f Aug 06 14:35:16.034648 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1131716616 Aug 06 14:35:16.034648 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User: tempest-VolumesSnapshotTestJSON-1131716616-project Aug 06 14:35:16.034648 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Domain-Id: default Aug 06 14:35:16.034648 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Domain-Name: Default Aug 06 14:35:16.034648 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Id: eb6f411ed91946eba54e46799edb12d3 Aug 06 14:35:16.034648 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Name: tempest-VolumesSnapshotTestJSON-1131716616-project Aug 06 14:35:16.034648 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: method: > Aug 06 14:35:16.034648 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: exception: Instance d30e3f96-04e3-4a5a-b38b-5fdf3be21595 could not be found. Aug 06 14:35:16.034648 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: action_args: {'id': 'd30e3f96-04e3-4a5a-b38b-5fdf3be21595'} Aug 06 14:35:16.035597 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 14:35:16.035597 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:35:16.035597 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 14:35:16.035597 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 14:35:16.035597 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 14:35:16.035597 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 14:35:16.035597 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 14:35:16.035597 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 14:35:16.035597 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 14:35:16.035597 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 14:35:16.035597 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d30e3f96-04e3-4a5a-b38b-5fdf3be21595 could not be found. Aug 06 14:35:16.035597 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:35:16.035597 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:35:16.035597 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:35:16.035597 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:35:16.035597 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:35:16.035597 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:35:16.035597 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 14:35:16.035597 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 14:35:16.035597 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 14:35:16.036855 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 14:35:16.036855 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 14:35:16.036855 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 14:35:16.036855 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 14:35:16.036855 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 14:35:16.036855 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 14:35:16.036855 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 14:35:16.036855 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d30e3f96-04e3-4a5a-b38b-5fdf3be21595 could not be found. Aug 06 14:35:16.036855 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:35:16.036855 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:35:16.036855 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:35:16.036855 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:35:16.036855 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:35:16.036855 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:35:16.036855 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 14:35:16.036855 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 14:35:16.036855 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d30e3f96-04e3-4a5a-b38b-5fdf3be21595 could not be found. Aug 06 14:35:16.036855 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:35:16.037974 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-c9e6a2b5-7677-491b-af88-72d8c31f92f7 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] Returning 404 to user: Instance d30e3f96-04e3-4a5a-b38b-5fdf3be21595 could not be found. {{(pid=117837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 14:35:16.037974 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-c9e6a2b5-7677-491b-af88-72d8c31f92f7 tempest-VolumesSnapshotTestJSON-1131716616 tempest-VolumesSnapshotTestJSON-1131716616-project] 10.222.0.17 "GET /compute/v2.1/servers/d30e3f96-04e3-4a5a-b38b-5fdf3be21595" status: 404 len: 111 microversion: 2.1 time: 0.031806 Aug 06 14:35:16.038642 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 368/687] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:35:16 2022] GET /compute/v2.1/servers/d30e3f96-04e3-4a5a-b38b-5fdf3be21595 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 06 14:35:16.049355 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-d3b15c3f-36e3-4646-9356-dae77fb930ce tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:16.059155 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-d3b15c3f-36e3-4646-9356-dae77fb930ce tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:16.060719 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-d3b15c3f-36e3-4646-9356-dae77fb930ce tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:16.061910 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-d3b15c3f-36e3-4646-9356-dae77fb930ce tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1810 microversion: 2.20 time: 0.168164 Aug 06 14:35:16.062456 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 320/688] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:35:15 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1810 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:35:17.084989 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-150175a3-b546-48f5-8c83-0643717aedfb tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:35:17.085586 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-150175a3-b546-48f5-8c83-0643717aedfb tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:35:17.091861 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-150175a3-b546-48f5-8c83-0643717aedfb tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:17.092342 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-150175a3-b546-48f5-8c83-0643717aedfb tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:17.092771 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-150175a3-b546-48f5-8c83-0643717aedfb tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:17.093444 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-150175a3-b546-48f5-8c83-0643717aedfb tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:17.093889 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-150175a3-b546-48f5-8c83-0643717aedfb tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:17.094306 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-150175a3-b546-48f5-8c83-0643717aedfb tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:17.224303 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-150175a3-b546-48f5-8c83-0643717aedfb tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:17.233204 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-150175a3-b546-48f5-8c83-0643717aedfb tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:17.234719 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-150175a3-b546-48f5-8c83-0643717aedfb tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:17.235886 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-150175a3-b546-48f5-8c83-0643717aedfb tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1810 microversion: 2.20 time: 0.154902 Aug 06 14:35:17.236438 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 369/689] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:35:17 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1810 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 14:35:18.259095 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-41214c27-352b-46a1-891f-8101e9e1634f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:35:18.259861 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-41214c27-352b-46a1-891f-8101e9e1634f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:35:18.266266 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-41214c27-352b-46a1-891f-8101e9e1634f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:18.266755 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-41214c27-352b-46a1-891f-8101e9e1634f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:18.267220 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-41214c27-352b-46a1-891f-8101e9e1634f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:18.267909 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-41214c27-352b-46a1-891f-8101e9e1634f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:18.268363 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-41214c27-352b-46a1-891f-8101e9e1634f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:18.268788 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-41214c27-352b-46a1-891f-8101e9e1634f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:18.400525 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-41214c27-352b-46a1-891f-8101e9e1634f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:18.408835 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-41214c27-352b-46a1-891f-8101e9e1634f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:18.410334 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-41214c27-352b-46a1-891f-8101e9e1634f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:18.411508 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-41214c27-352b-46a1-891f-8101e9e1634f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1810 microversion: 2.20 time: 0.156364 Aug 06 14:35:18.412059 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 321/690] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:35:18 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1810 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:35:19.435383 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-14c1d372-6329-4dc0-9305-c26419e344c3 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:35:19.435977 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-14c1d372-6329-4dc0-9305-c26419e344c3 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:35:19.442319 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-14c1d372-6329-4dc0-9305-c26419e344c3 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:19.442796 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-14c1d372-6329-4dc0-9305-c26419e344c3 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:19.443262 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-14c1d372-6329-4dc0-9305-c26419e344c3 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:19.443943 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-14c1d372-6329-4dc0-9305-c26419e344c3 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:19.444400 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-14c1d372-6329-4dc0-9305-c26419e344c3 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:19.444819 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-14c1d372-6329-4dc0-9305-c26419e344c3 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:19.572469 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-14c1d372-6329-4dc0-9305-c26419e344c3 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:19.581616 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-14c1d372-6329-4dc0-9305-c26419e344c3 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:19.583138 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-14c1d372-6329-4dc0-9305-c26419e344c3 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:19.584283 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-14c1d372-6329-4dc0-9305-c26419e344c3 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1810 microversion: 2.20 time: 0.153657 Aug 06 14:35:19.584824 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 370/691] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:35:19 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1810 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:35:20.606918 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-296be7db-0a42-4824-8441-a202958cded9 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:35:20.607525 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-296be7db-0a42-4824-8441-a202958cded9 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:35:20.614063 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-296be7db-0a42-4824-8441-a202958cded9 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:20.614547 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-296be7db-0a42-4824-8441-a202958cded9 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:20.615006 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-296be7db-0a42-4824-8441-a202958cded9 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:20.615690 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-296be7db-0a42-4824-8441-a202958cded9 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:20.616148 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-296be7db-0a42-4824-8441-a202958cded9 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:20.616563 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-296be7db-0a42-4824-8441-a202958cded9 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:20.620577 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:35:20.746429 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-296be7db-0a42-4824-8441-a202958cded9 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:20.754830 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-296be7db-0a42-4824-8441-a202958cded9 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:20.756352 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-296be7db-0a42-4824-8441-a202958cded9 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:20.757496 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-296be7db-0a42-4824-8441-a202958cded9 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1810 microversion: 2.20 time: 0.154644 Aug 06 14:35:20.758041 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 322/692] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:35:20 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1810 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:35:21.781156 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-f246199d-0947-48c0-93e8-572b1458ee13 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:35:21.781749 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-f246199d-0947-48c0-93e8-572b1458ee13 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:35:21.788197 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f246199d-0947-48c0-93e8-572b1458ee13 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:21.788678 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f246199d-0947-48c0-93e8-572b1458ee13 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:21.789117 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f246199d-0947-48c0-93e8-572b1458ee13 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:21.789808 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f246199d-0947-48c0-93e8-572b1458ee13 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:21.790266 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f246199d-0947-48c0-93e8-572b1458ee13 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:21.790690 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f246199d-0947-48c0-93e8-572b1458ee13 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:21.923137 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-f246199d-0947-48c0-93e8-572b1458ee13 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:21.931397 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-f246199d-0947-48c0-93e8-572b1458ee13 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:21.933159 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-f246199d-0947-48c0-93e8-572b1458ee13 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:21.934296 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-f246199d-0947-48c0-93e8-572b1458ee13 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1810 microversion: 2.20 time: 0.157055 Aug 06 14:35:21.934838 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 371/693] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:35:21 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:35:22.958101 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-4a4560f1-055d-4ff1-a4f7-2a84632f5ac1 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:35:22.959110 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-4a4560f1-055d-4ff1-a4f7-2a84632f5ac1 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:35:22.967160 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4a4560f1-055d-4ff1-a4f7-2a84632f5ac1 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:22.967873 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4a4560f1-055d-4ff1-a4f7-2a84632f5ac1 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:22.968537 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4a4560f1-055d-4ff1-a4f7-2a84632f5ac1 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:22.969403 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4a4560f1-055d-4ff1-a4f7-2a84632f5ac1 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:22.969924 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4a4560f1-055d-4ff1-a4f7-2a84632f5ac1 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:22.970419 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4a4560f1-055d-4ff1-a4f7-2a84632f5ac1 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:23.108886 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-4a4560f1-055d-4ff1-a4f7-2a84632f5ac1 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:23.117293 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-4a4560f1-055d-4ff1-a4f7-2a84632f5ac1 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:23.118792 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-4a4560f1-055d-4ff1-a4f7-2a84632f5ac1 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:23.120038 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-4a4560f1-055d-4ff1-a4f7-2a84632f5ac1 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1810 microversion: 2.20 time: 0.166384 Aug 06 14:35:23.120592 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 323/694] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:35:22 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1810 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:35:24.142971 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-319b693b-0f65-424b-8ea6-8ed67c08a43d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:35:24.143590 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-319b693b-0f65-424b-8ea6-8ed67c08a43d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:35:24.150259 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-319b693b-0f65-424b-8ea6-8ed67c08a43d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:24.154365 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-319b693b-0f65-424b-8ea6-8ed67c08a43d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:24.154365 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-319b693b-0f65-424b-8ea6-8ed67c08a43d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:24.154365 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-319b693b-0f65-424b-8ea6-8ed67c08a43d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:24.154365 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-319b693b-0f65-424b-8ea6-8ed67c08a43d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:24.154832 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-319b693b-0f65-424b-8ea6-8ed67c08a43d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:24.251360 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [req-c348e907-a80e-4c2b-9d67-71e6642f489b req-ca3da59e-ba9b-45a7-a5bf-02dc515d1a8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cf29bae-83f8-43e3-9118-0fea5a019ff8", "name": "network-vif-plugged", "status": "completed", "tag": "988ecdda-956b-4c8b-8ee4-231ef3ed0bb2"}]} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:35:24.261708 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-c348e907-a80e-4c2b-9d67-71e6642f489b req-ca3da59e-ba9b-45a7-a5bf-02dc515d1a8c service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:24.262160 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-c348e907-a80e-4c2b-9d67-71e6642f489b req-ca3da59e-ba9b-45a7-a5bf-02dc515d1a8c service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:24.262595 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-c348e907-a80e-4c2b-9d67-71e6642f489b req-ca3da59e-ba9b-45a7-a5bf-02dc515d1a8c service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:24.274201 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.compute.server_external_events [req-c348e907-a80e-4c2b-9d67-71e6642f489b req-ca3da59e-ba9b-45a7-a5bf-02dc515d1a8c service nova] Creating event network-vif-plugged:988ecdda-956b-4c8b-8ee4-231ef3ed0bb2 for instance 5cf29bae-83f8-43e3-9118-0fea5a019ff8 on hv-cinder-85199 Aug 06 14:35:24.279796 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [req-c348e907-a80e-4c2b-9d67-71e6642f489b req-ca3da59e-ba9b-45a7-a5bf-02dc515d1a8c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031995 Aug 06 14:35:24.280386 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 324/695] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:35:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 14:35:24.292172 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-319b693b-0f65-424b-8ea6-8ed67c08a43d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:24.300604 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-319b693b-0f65-424b-8ea6-8ed67c08a43d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:24.302385 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-319b693b-0f65-424b-8ea6-8ed67c08a43d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:24.303565 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-319b693b-0f65-424b-8ea6-8ed67c08a43d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1810 microversion: 2.20 time: 0.165035 Aug 06 14:35:24.304112 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 372/696] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:35:24 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1810 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:35:25.328271 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-044ab2b3-19a8-42ab-a644-9f1c2bd80e33 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:35:25.328960 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-044ab2b3-19a8-42ab-a644-9f1c2bd80e33 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:35:25.334934 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-044ab2b3-19a8-42ab-a644-9f1c2bd80e33 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:25.335418 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-044ab2b3-19a8-42ab-a644-9f1c2bd80e33 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:25.335847 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-044ab2b3-19a8-42ab-a644-9f1c2bd80e33 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:25.336529 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-044ab2b3-19a8-42ab-a644-9f1c2bd80e33 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:25.336976 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-044ab2b3-19a8-42ab-a644-9f1c2bd80e33 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:25.337390 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-044ab2b3-19a8-42ab-a644-9f1c2bd80e33 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:25.477534 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-044ab2b3-19a8-42ab-a644-9f1c2bd80e33 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:25.487753 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-044ab2b3-19a8-42ab-a644-9f1c2bd80e33 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:25.489979 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-044ab2b3-19a8-42ab-a644-9f1c2bd80e33 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:25.491349 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-044ab2b3-19a8-42ab-a644-9f1c2bd80e33 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1810 microversion: 2.20 time: 0.167815 Aug 06 14:35:25.492563 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 325/697] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:35:25 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1810 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:35:26.515195 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-ceeb5f74-06c9-4a49-8357-0ca5d7746b7c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:35:26.515794 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-ceeb5f74-06c9-4a49-8357-0ca5d7746b7c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:35:26.522232 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ceeb5f74-06c9-4a49-8357-0ca5d7746b7c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:26.522916 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ceeb5f74-06c9-4a49-8357-0ca5d7746b7c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:26.523167 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ceeb5f74-06c9-4a49-8357-0ca5d7746b7c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:26.524126 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ceeb5f74-06c9-4a49-8357-0ca5d7746b7c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:26.524572 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ceeb5f74-06c9-4a49-8357-0ca5d7746b7c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:26.525060 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ceeb5f74-06c9-4a49-8357-0ca5d7746b7c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:26.664648 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-ceeb5f74-06c9-4a49-8357-0ca5d7746b7c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:26.673875 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-ceeb5f74-06c9-4a49-8357-0ca5d7746b7c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:26.675386 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-ceeb5f74-06c9-4a49-8357-0ca5d7746b7c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:26.676538 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-ceeb5f74-06c9-4a49-8357-0ca5d7746b7c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1810 microversion: 2.20 time: 0.165332 Aug 06 14:35:26.677090 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 373/698] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:35:26 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1810 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:35:27.699883 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-54254c74-de7d-4521-89c4-08924e35f876 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:35:27.700481 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-54254c74-de7d-4521-89c4-08924e35f876 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:35:27.706819 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-54254c74-de7d-4521-89c4-08924e35f876 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:27.707331 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-54254c74-de7d-4521-89c4-08924e35f876 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:27.707763 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-54254c74-de7d-4521-89c4-08924e35f876 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:27.708445 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-54254c74-de7d-4521-89c4-08924e35f876 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:27.708923 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-54254c74-de7d-4521-89c4-08924e35f876 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:27.709347 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-54254c74-de7d-4521-89c4-08924e35f876 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:27.841086 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-54254c74-de7d-4521-89c4-08924e35f876 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:27.849580 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-54254c74-de7d-4521-89c4-08924e35f876 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:27.851109 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-54254c74-de7d-4521-89c4-08924e35f876 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:27.852264 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-54254c74-de7d-4521-89c4-08924e35f876 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1810 microversion: 2.20 time: 0.156406 Aug 06 14:35:27.852816 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 326/699] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:35:27 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1810 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:35:28.875661 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-bf672378-c362-4a9d-89ef-789d84179e8e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:35:28.876316 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-bf672378-c362-4a9d-89ef-789d84179e8e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:35:28.882788 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-bf672378-c362-4a9d-89ef-789d84179e8e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:28.883295 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-bf672378-c362-4a9d-89ef-789d84179e8e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:28.883720 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-bf672378-c362-4a9d-89ef-789d84179e8e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:28.884429 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-bf672378-c362-4a9d-89ef-789d84179e8e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:28.884876 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-bf672378-c362-4a9d-89ef-789d84179e8e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:28.885802 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-bf672378-c362-4a9d-89ef-789d84179e8e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:29.012860 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-bf672378-c362-4a9d-89ef-789d84179e8e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:29.021292 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-bf672378-c362-4a9d-89ef-789d84179e8e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:29.022793 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-bf672378-c362-4a9d-89ef-789d84179e8e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:29.023982 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-bf672378-c362-4a9d-89ef-789d84179e8e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1810 microversion: 2.20 time: 0.152259 Aug 06 14:35:29.024528 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 374/700] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:35:28 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1810 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:35:30.046918 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-06d9bdb9-ac37-4511-be03-f78f0dab93aa tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:35:30.047525 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-06d9bdb9-ac37-4511-be03-f78f0dab93aa tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:35:30.053857 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-06d9bdb9-ac37-4511-be03-f78f0dab93aa tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:30.054334 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-06d9bdb9-ac37-4511-be03-f78f0dab93aa tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:30.054763 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-06d9bdb9-ac37-4511-be03-f78f0dab93aa tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:30.055477 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-06d9bdb9-ac37-4511-be03-f78f0dab93aa tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:30.055925 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-06d9bdb9-ac37-4511-be03-f78f0dab93aa tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:30.056343 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-06d9bdb9-ac37-4511-be03-f78f0dab93aa tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:30.183565 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-06d9bdb9-ac37-4511-be03-f78f0dab93aa tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:30.191920 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-06d9bdb9-ac37-4511-be03-f78f0dab93aa tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:30.193412 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-06d9bdb9-ac37-4511-be03-f78f0dab93aa tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:30.194557 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-06d9bdb9-ac37-4511-be03-f78f0dab93aa tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1810 microversion: 2.20 time: 0.151541 Aug 06 14:35:30.195146 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 327/701] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:35:30 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1810 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:35:31.218269 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-3df53a42-3af4-4a7a-9a32-d28a61cfde5e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:35:31.218968 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-3df53a42-3af4-4a7a-9a32-d28a61cfde5e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:35:31.224954 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-3df53a42-3af4-4a7a-9a32-d28a61cfde5e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:31.225436 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-3df53a42-3af4-4a7a-9a32-d28a61cfde5e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:31.225871 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-3df53a42-3af4-4a7a-9a32-d28a61cfde5e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:31.226649 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-3df53a42-3af4-4a7a-9a32-d28a61cfde5e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:31.227126 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-3df53a42-3af4-4a7a-9a32-d28a61cfde5e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:31.227546 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-3df53a42-3af4-4a7a-9a32-d28a61cfde5e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:31.355778 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-3df53a42-3af4-4a7a-9a32-d28a61cfde5e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:31.364241 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-3df53a42-3af4-4a7a-9a32-d28a61cfde5e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:31.365759 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-3df53a42-3af4-4a7a-9a32-d28a61cfde5e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:31.366961 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-3df53a42-3af4-4a7a-9a32-d28a61cfde5e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1810 microversion: 2.20 time: 0.152624 Aug 06 14:35:31.367537 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 375/702] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:35:31 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1810 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:35:32.389914 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-b0693ac7-cb77-44e7-8edc-f7147fbfe2ee tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:35:32.391383 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-b0693ac7-cb77-44e7-8edc-f7147fbfe2ee tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:35:32.397884 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b0693ac7-cb77-44e7-8edc-f7147fbfe2ee tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:32.398362 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b0693ac7-cb77-44e7-8edc-f7147fbfe2ee tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:32.398788 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b0693ac7-cb77-44e7-8edc-f7147fbfe2ee tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:32.399514 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b0693ac7-cb77-44e7-8edc-f7147fbfe2ee tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:32.399963 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b0693ac7-cb77-44e7-8edc-f7147fbfe2ee tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:32.400375 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b0693ac7-cb77-44e7-8edc-f7147fbfe2ee tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:32.531665 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-b0693ac7-cb77-44e7-8edc-f7147fbfe2ee tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:32.539826 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-b0693ac7-cb77-44e7-8edc-f7147fbfe2ee tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:32.541780 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-b0693ac7-cb77-44e7-8edc-f7147fbfe2ee tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:32.542965 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-b0693ac7-cb77-44e7-8edc-f7147fbfe2ee tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1810 microversion: 2.20 time: 0.157201 Aug 06 14:35:32.543517 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 328/703] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:35:32 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1810 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:35:33.566367 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-ecbe50b4-27b0-4089-855c-316f7d99f726 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:35:33.566914 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-ecbe50b4-27b0-4089-855c-316f7d99f726 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:35:33.573840 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ecbe50b4-27b0-4089-855c-316f7d99f726 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:33.574309 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ecbe50b4-27b0-4089-855c-316f7d99f726 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:33.574822 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ecbe50b4-27b0-4089-855c-316f7d99f726 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:33.575471 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ecbe50b4-27b0-4089-855c-316f7d99f726 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:33.575948 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ecbe50b4-27b0-4089-855c-316f7d99f726 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:33.576388 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ecbe50b4-27b0-4089-855c-316f7d99f726 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:33.710253 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-ecbe50b4-27b0-4089-855c-316f7d99f726 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:33.718664 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-ecbe50b4-27b0-4089-855c-316f7d99f726 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:33.720180 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-ecbe50b4-27b0-4089-855c-316f7d99f726 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:33.721326 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-ecbe50b4-27b0-4089-855c-316f7d99f726 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1797 microversion: 2.20 time: 0.158893 Aug 06 14:35:33.721870 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 376/704] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:35:33 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1797 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:35:39.981834 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-c444dced-d3ef-45a3-be87-97c2b3f40d8b tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:35:39.984161 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-c444dced-d3ef-45a3-be87-97c2b3f40d8b tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] [instance: cb14f0c5-5a75-4357-b1d3-78a2174cca02] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:35:39.987634 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_api:SELECT=36 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:35:39.991467 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c444dced-d3ef-45a3-be87-97c2b3f40d8b tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:39.991960 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c444dced-d3ef-45a3-be87-97c2b3f40d8b tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:39.992400 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c444dced-d3ef-45a3-be87-97c2b3f40d8b tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:39.993102 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c444dced-d3ef-45a3-be87-97c2b3f40d8b tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:39.993557 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c444dced-d3ef-45a3-be87-97c2b3f40d8b tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:39.993983 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c444dced-d3ef-45a3-be87-97c2b3f40d8b tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:40.069815 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-c444dced-d3ef-45a3-be87-97c2b3f40d8b tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] 10.222.0.17 "POST /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02/action" status: 202 len: 0 microversion: 2.1 time: 0.091591 Aug 06 14:35:40.074130 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 329/705] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Aug 6 14:35:39 2022] POST /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 14:35:40.081316 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-e819a12b-20da-4abe-a559-c3363f307b4a tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:35:40.081720 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-e819a12b-20da-4abe-a559-c3363f307b4a tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] [instance: cb14f0c5-5a75-4357-b1d3-78a2174cca02] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:35:40.091531 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e819a12b-20da-4abe-a559-c3363f307b4a tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:40.092036 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e819a12b-20da-4abe-a559-c3363f307b4a tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:40.093240 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e819a12b-20da-4abe-a559-c3363f307b4a tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:40.094206 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e819a12b-20da-4abe-a559-c3363f307b4a tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:40.094657 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e819a12b-20da-4abe-a559-c3363f307b4a tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:40.095165 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e819a12b-20da-4abe-a559-c3363f307b4a tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:40.322239 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-e819a12b-20da-4abe-a559-c3363f307b4a tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96728f2ae5d4885858560396971a1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a30d14e9a4c0ebd2fd8549a09ee44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:40.330616 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-e819a12b-20da-4abe-a559-c3363f307b4a tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] 10.222.0.17 "GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02" status: 200 len: 1752 microversion: 2.1 time: 0.253831 Aug 06 14:35:40.331201 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 377/706] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:35:40 2022] GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02 => generated 1752 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:35:41.351679 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-397d20bf-64b6-47df-ab91-81ef62756e35 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:35:41.352373 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-397d20bf-64b6-47df-ab91-81ef62756e35 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] [instance: cb14f0c5-5a75-4357-b1d3-78a2174cca02] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:35:41.358340 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-397d20bf-64b6-47df-ab91-81ef62756e35 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:41.358809 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-397d20bf-64b6-47df-ab91-81ef62756e35 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:41.359262 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-397d20bf-64b6-47df-ab91-81ef62756e35 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:41.359934 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-397d20bf-64b6-47df-ab91-81ef62756e35 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:41.360433 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-397d20bf-64b6-47df-ab91-81ef62756e35 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:41.360847 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-397d20bf-64b6-47df-ab91-81ef62756e35 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:41.507401 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-397d20bf-64b6-47df-ab91-81ef62756e35 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96728f2ae5d4885858560396971a1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a30d14e9a4c0ebd2fd8549a09ee44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:41.515711 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-397d20bf-64b6-47df-ab91-81ef62756e35 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] 10.222.0.17 "GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02" status: 200 len: 1757 microversion: 2.1 time: 0.168712 Aug 06 14:35:41.516263 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 330/707] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:35:41 2022] GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:35:42.538294 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-608d7cfc-bfc8-4f4a-bf2e-61773ce40429 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:35:42.538973 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-608d7cfc-bfc8-4f4a-bf2e-61773ce40429 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] [instance: cb14f0c5-5a75-4357-b1d3-78a2174cca02] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:35:42.546491 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-608d7cfc-bfc8-4f4a-bf2e-61773ce40429 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:42.546990 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-608d7cfc-bfc8-4f4a-bf2e-61773ce40429 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:42.547419 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-608d7cfc-bfc8-4f4a-bf2e-61773ce40429 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:42.548282 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-608d7cfc-bfc8-4f4a-bf2e-61773ce40429 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:42.549250 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-608d7cfc-bfc8-4f4a-bf2e-61773ce40429 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:42.549676 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-608d7cfc-bfc8-4f4a-bf2e-61773ce40429 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:43.047383 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-608d7cfc-bfc8-4f4a-bf2e-61773ce40429 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96728f2ae5d4885858560396971a1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a30d14e9a4c0ebd2fd8549a09ee44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:43.055319 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-608d7cfc-bfc8-4f4a-bf2e-61773ce40429 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] 10.222.0.17 "GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02" status: 200 len: 1757 microversion: 2.1 time: 0.520946 Aug 06 14:35:43.055950 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 378/708] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:35:42 2022] GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02 => generated 1757 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:35:44.076698 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-cfe76508-7c37-4870-a496-7240fb157b99 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:35:44.077262 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-cfe76508-7c37-4870-a496-7240fb157b99 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] [instance: cb14f0c5-5a75-4357-b1d3-78a2174cca02] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:35:44.083790 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-cfe76508-7c37-4870-a496-7240fb157b99 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:44.084267 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-cfe76508-7c37-4870-a496-7240fb157b99 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:44.084718 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-cfe76508-7c37-4870-a496-7240fb157b99 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:44.085406 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-cfe76508-7c37-4870-a496-7240fb157b99 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:44.085853 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-cfe76508-7c37-4870-a496-7240fb157b99 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:44.086273 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-cfe76508-7c37-4870-a496-7240fb157b99 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:44.229603 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-cfe76508-7c37-4870-a496-7240fb157b99 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96728f2ae5d4885858560396971a1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a30d14e9a4c0ebd2fd8549a09ee44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:44.238068 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-cfe76508-7c37-4870-a496-7240fb157b99 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] 10.222.0.17 "GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02" status: 200 len: 1757 microversion: 2.1 time: 0.165310 Aug 06 14:35:44.238625 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 331/709] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:35:44 2022] GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:35:45.259266 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-f670b0ed-00ec-4cef-b477-e7786061107d tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:35:45.259898 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-f670b0ed-00ec-4cef-b477-e7786061107d tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] [instance: cb14f0c5-5a75-4357-b1d3-78a2174cca02] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:35:45.262225 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_api:SELECT=30 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:35:45.267763 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f670b0ed-00ec-4cef-b477-e7786061107d tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:45.268450 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f670b0ed-00ec-4cef-b477-e7786061107d tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:45.268661 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f670b0ed-00ec-4cef-b477-e7786061107d tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:45.269347 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f670b0ed-00ec-4cef-b477-e7786061107d tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:45.269799 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f670b0ed-00ec-4cef-b477-e7786061107d tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:45.270218 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f670b0ed-00ec-4cef-b477-e7786061107d tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:45.272801 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_cell1:SELECT=67 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:35:45.408382 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-f670b0ed-00ec-4cef-b477-e7786061107d tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96728f2ae5d4885858560396971a1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a30d14e9a4c0ebd2fd8549a09ee44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:45.416503 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-f670b0ed-00ec-4cef-b477-e7786061107d tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] 10.222.0.17 "GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02" status: 200 len: 1757 microversion: 2.1 time: 0.161081 Aug 06 14:35:45.417058 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 379/710] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:35:45 2022] GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02 => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:35:46.438660 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-bd1a8db9-b3a3-4743-83d8-826d21f44b8c tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:35:46.439279 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-bd1a8db9-b3a3-4743-83d8-826d21f44b8c tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] [instance: cb14f0c5-5a75-4357-b1d3-78a2174cca02] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:35:46.445618 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-bd1a8db9-b3a3-4743-83d8-826d21f44b8c tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:46.446091 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-bd1a8db9-b3a3-4743-83d8-826d21f44b8c tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:46.446514 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-bd1a8db9-b3a3-4743-83d8-826d21f44b8c tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:46.447211 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-bd1a8db9-b3a3-4743-83d8-826d21f44b8c tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:46.447659 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-bd1a8db9-b3a3-4743-83d8-826d21f44b8c tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:46.448074 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-bd1a8db9-b3a3-4743-83d8-826d21f44b8c tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:46.588219 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-bd1a8db9-b3a3-4743-83d8-826d21f44b8c tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96728f2ae5d4885858560396971a1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a30d14e9a4c0ebd2fd8549a09ee44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:46.596126 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-bd1a8db9-b3a3-4743-83d8-826d21f44b8c tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] 10.222.0.17 "GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02" status: 200 len: 1757 microversion: 2.1 time: 0.161801 Aug 06 14:35:46.596686 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 332/711] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:35:46 2022] GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02 => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:35:47.616436 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-d6e278b5-3e61-4469-94cf-036e0870394f tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:35:47.617076 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-d6e278b5-3e61-4469-94cf-036e0870394f tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] [instance: cb14f0c5-5a75-4357-b1d3-78a2174cca02] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:35:47.623405 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d6e278b5-3e61-4469-94cf-036e0870394f tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:47.623881 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d6e278b5-3e61-4469-94cf-036e0870394f tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:47.624310 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d6e278b5-3e61-4469-94cf-036e0870394f tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:47.624996 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d6e278b5-3e61-4469-94cf-036e0870394f tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:47.625448 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d6e278b5-3e61-4469-94cf-036e0870394f tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:47.625867 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d6e278b5-3e61-4469-94cf-036e0870394f tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:47.768796 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-d6e278b5-3e61-4469-94cf-036e0870394f tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96728f2ae5d4885858560396971a1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a30d14e9a4c0ebd2fd8549a09ee44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:47.776680 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-d6e278b5-3e61-4469-94cf-036e0870394f tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] 10.222.0.17 "GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02" status: 200 len: 1757 microversion: 2.1 time: 0.164103 Aug 06 14:35:47.777230 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 380/712] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:35:47 2022] GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:35:48.797418 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-efd59df9-cef8-4a63-b1cc-6b8a7988dc87 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:35:48.798025 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-efd59df9-cef8-4a63-b1cc-6b8a7988dc87 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] [instance: cb14f0c5-5a75-4357-b1d3-78a2174cca02] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:35:48.804444 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-efd59df9-cef8-4a63-b1cc-6b8a7988dc87 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:48.804918 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-efd59df9-cef8-4a63-b1cc-6b8a7988dc87 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:48.805347 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-efd59df9-cef8-4a63-b1cc-6b8a7988dc87 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:48.806025 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-efd59df9-cef8-4a63-b1cc-6b8a7988dc87 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:48.806471 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-efd59df9-cef8-4a63-b1cc-6b8a7988dc87 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:48.807176 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-efd59df9-cef8-4a63-b1cc-6b8a7988dc87 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:48.947032 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-efd59df9-cef8-4a63-b1cc-6b8a7988dc87 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96728f2ae5d4885858560396971a1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a30d14e9a4c0ebd2fd8549a09ee44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:48.955464 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-efd59df9-cef8-4a63-b1cc-6b8a7988dc87 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] 10.222.0.17 "GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02" status: 200 len: 1757 microversion: 2.1 time: 0.161922 Aug 06 14:35:48.956012 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 333/713] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:35:48 2022] GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02 => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:35:49.976690 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-739e01d1-ecb4-4b9a-9a50-fb671f71f88b tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:35:49.977297 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-739e01d1-ecb4-4b9a-9a50-fb671f71f88b tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] [instance: cb14f0c5-5a75-4357-b1d3-78a2174cca02] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:35:49.984258 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-739e01d1-ecb4-4b9a-9a50-fb671f71f88b tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:49.984753 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-739e01d1-ecb4-4b9a-9a50-fb671f71f88b tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:49.985166 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-739e01d1-ecb4-4b9a-9a50-fb671f71f88b tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:49.985845 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-739e01d1-ecb4-4b9a-9a50-fb671f71f88b tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:49.986290 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-739e01d1-ecb4-4b9a-9a50-fb671f71f88b tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:49.986703 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-739e01d1-ecb4-4b9a-9a50-fb671f71f88b tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:50.127141 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-739e01d1-ecb4-4b9a-9a50-fb671f71f88b tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96728f2ae5d4885858560396971a1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a30d14e9a4c0ebd2fd8549a09ee44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:50.134953 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-739e01d1-ecb4-4b9a-9a50-fb671f71f88b tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] 10.222.0.17 "GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02" status: 200 len: 1757 microversion: 2.1 time: 0.162081 Aug 06 14:35:50.135538 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 381/714] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:35:49 2022] GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02 => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:35:51.155757 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-dfc1e6cb-8f5c-4c22-b360-5d4e324d5e4b tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:35:51.156358 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-dfc1e6cb-8f5c-4c22-b360-5d4e324d5e4b tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] [instance: cb14f0c5-5a75-4357-b1d3-78a2174cca02] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:35:51.162667 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-dfc1e6cb-8f5c-4c22-b360-5d4e324d5e4b tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:51.163166 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-dfc1e6cb-8f5c-4c22-b360-5d4e324d5e4b tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:51.163590 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-dfc1e6cb-8f5c-4c22-b360-5d4e324d5e4b tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:51.164265 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-dfc1e6cb-8f5c-4c22-b360-5d4e324d5e4b tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:51.164735 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-dfc1e6cb-8f5c-4c22-b360-5d4e324d5e4b tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:51.165150 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-dfc1e6cb-8f5c-4c22-b360-5d4e324d5e4b tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:51.169549 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:35:51.311877 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-dfc1e6cb-8f5c-4c22-b360-5d4e324d5e4b tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96728f2ae5d4885858560396971a1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a30d14e9a4c0ebd2fd8549a09ee44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:51.319648 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-dfc1e6cb-8f5c-4c22-b360-5d4e324d5e4b tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] 10.222.0.17 "GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02" status: 200 len: 1757 microversion: 2.1 time: 0.167764 Aug 06 14:35:51.320208 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 334/715] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:35:51 2022] GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:35:52.341033 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-fc15ee18-4f41-4fc8-b5af-323b320a9b4f tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:35:52.341638 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-fc15ee18-4f41-4fc8-b5af-323b320a9b4f tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] [instance: cb14f0c5-5a75-4357-b1d3-78a2174cca02] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:35:52.347977 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-fc15ee18-4f41-4fc8-b5af-323b320a9b4f tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:52.348460 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-fc15ee18-4f41-4fc8-b5af-323b320a9b4f tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:52.348895 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-fc15ee18-4f41-4fc8-b5af-323b320a9b4f tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:52.349580 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-fc15ee18-4f41-4fc8-b5af-323b320a9b4f tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:52.350033 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-fc15ee18-4f41-4fc8-b5af-323b320a9b4f tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:52.350455 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-fc15ee18-4f41-4fc8-b5af-323b320a9b4f tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:52.492393 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-fc15ee18-4f41-4fc8-b5af-323b320a9b4f tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96728f2ae5d4885858560396971a1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a30d14e9a4c0ebd2fd8549a09ee44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:52.500859 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-fc15ee18-4f41-4fc8-b5af-323b320a9b4f tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] 10.222.0.17 "GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02" status: 200 len: 1757 microversion: 2.1 time: 0.163677 Aug 06 14:35:52.501417 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 382/716] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:35:52 2022] GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:35:53.523420 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-49de4e6c-5a7c-4ea3-8f77-ffae658130dc tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:35:53.523952 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-49de4e6c-5a7c-4ea3-8f77-ffae658130dc tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] [instance: cb14f0c5-5a75-4357-b1d3-78a2174cca02] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:35:53.530821 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-49de4e6c-5a7c-4ea3-8f77-ffae658130dc tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:53.531323 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-49de4e6c-5a7c-4ea3-8f77-ffae658130dc tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:53.531750 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-49de4e6c-5a7c-4ea3-8f77-ffae658130dc tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:53.532423 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-49de4e6c-5a7c-4ea3-8f77-ffae658130dc tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:53.532871 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-49de4e6c-5a7c-4ea3-8f77-ffae658130dc tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:53.533288 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-49de4e6c-5a7c-4ea3-8f77-ffae658130dc tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:53.677480 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-49de4e6c-5a7c-4ea3-8f77-ffae658130dc tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96728f2ae5d4885858560396971a1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a30d14e9a4c0ebd2fd8549a09ee44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:35:53.686118 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-49de4e6c-5a7c-4ea3-8f77-ffae658130dc tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] 10.222.0.17 "GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02" status: 200 len: 1760 microversion: 2.1 time: 0.166546 Aug 06 14:35:53.686670 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 335/717] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:35:53 2022] GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02 => generated 1760 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:35:54.770310 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-6cf2e6e2-5e4e-45ce-a076-72585770f82e tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e5569621-03ca-4d10-9cd6-fc59ef122000"}} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:35:54.772705 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-6cf2e6e2-5e4e-45ce-a076-72585770f82e tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 8805d1fa-6d65-45c7-ae75-17e46feccccb] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:35:54.779211 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6cf2e6e2-5e4e-45ce-a076-72585770f82e tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:54.779691 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6cf2e6e2-5e4e-45ce-a076-72585770f82e tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:54.780124 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6cf2e6e2-5e4e-45ce-a076-72585770f82e tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:54.780809 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6cf2e6e2-5e4e-45ce-a076-72585770f82e tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:35:54.781260 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6cf2e6e2-5e4e-45ce-a076-72585770f82e tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:35:54.781685 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6cf2e6e2-5e4e-45ce-a076-72585770f82e tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:35:55.047425 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-6cf2e6e2-5e4e-45ce-a076-72585770f82e tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "POST /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.492063 Aug 06 14:35:55.048027 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 383/718] 10.222.0.17 () {60 vars in 1323 bytes} [Sat Aug 6 14:35:54 2022] POST /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb/os-volume_attachments => generated 194 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:36:02.561261 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-c0d35710-c01c-48c6-9e19-e8ccbf7dda9d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:36:02.563517 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-c0d35710-c01c-48c6-9e19-e8ccbf7dda9d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 8805d1fa-6d65-45c7-ae75-17e46feccccb] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:02.569942 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c0d35710-c01c-48c6-9e19-e8ccbf7dda9d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:02.570411 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c0d35710-c01c-48c6-9e19-e8ccbf7dda9d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:02.570838 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c0d35710-c01c-48c6-9e19-e8ccbf7dda9d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:02.571530 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c0d35710-c01c-48c6-9e19-e8ccbf7dda9d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:02.571979 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c0d35710-c01c-48c6-9e19-e8ccbf7dda9d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:02.572393 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c0d35710-c01c-48c6-9e19-e8ccbf7dda9d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:02.595447 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.objects.instance [None req-c0d35710-c01c-48c6-9e19-e8ccbf7dda9d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lazy-loading 'flavor' on Instance uuid 8805d1fa-6d65-45c7-ae75-17e46feccccb {{(pid=117838) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 14:36:02.714898 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-c0d35710-c01c-48c6-9e19-e8ccbf7dda9d tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "POST /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb/action" status: 200 len: 32 microversion: 2.1 time: 0.158289 Aug 06 14:36:02.715935 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 336/719] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Aug 6 14:36:02 2022] POST /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb/action => generated 32 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 14:36:02.725924 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-2da29aad-4ceb-4187-946f-33ca7cef4190 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:02.726747 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-2da29aad-4ceb-4187-946f-33ca7cef4190 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 8805d1fa-6d65-45c7-ae75-17e46feccccb] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:02.734357 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2da29aad-4ceb-4187-946f-33ca7cef4190 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:02.734902 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2da29aad-4ceb-4187-946f-33ca7cef4190 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:02.735351 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2da29aad-4ceb-4187-946f-33ca7cef4190 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:02.736136 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2da29aad-4ceb-4187-946f-33ca7cef4190 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:02.736686 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2da29aad-4ceb-4187-946f-33ca7cef4190 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:02.737088 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2da29aad-4ceb-4187-946f-33ca7cef4190 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:02.958593 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-2da29aad-4ceb-4187-946f-33ca7cef4190 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:02.968188 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-2da29aad-4ceb-4187-946f-33ca7cef4190 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb" status: 200 len: 1734 microversion: 2.1 time: 0.246405 Aug 06 14:36:02.968889 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 384/720] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:36:02 2022] GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb => generated 1734 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:36:03.990644 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-08a293d6-3791-47de-ac0f-c5deb2cc9287 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:03.991308 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-08a293d6-3791-47de-ac0f-c5deb2cc9287 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 8805d1fa-6d65-45c7-ae75-17e46feccccb] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:03.998045 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-08a293d6-3791-47de-ac0f-c5deb2cc9287 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:03.998529 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-08a293d6-3791-47de-ac0f-c5deb2cc9287 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:03.998997 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-08a293d6-3791-47de-ac0f-c5deb2cc9287 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:03.999688 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-08a293d6-3791-47de-ac0f-c5deb2cc9287 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:04.000147 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-08a293d6-3791-47de-ac0f-c5deb2cc9287 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:04.000568 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-08a293d6-3791-47de-ac0f-c5deb2cc9287 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:04.130146 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-08a293d6-3791-47de-ac0f-c5deb2cc9287 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:04.138007 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-08a293d6-3791-47de-ac0f-c5deb2cc9287 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb" status: 200 len: 1734 microversion: 2.1 time: 0.152127 Aug 06 14:36:04.138570 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 337/721] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:36:03 2022] GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:36:05.161700 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-38ae8d91-4336-4a06-8741-04b88f28d152 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:05.162342 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-38ae8d91-4336-4a06-8741-04b88f28d152 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 8805d1fa-6d65-45c7-ae75-17e46feccccb] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:05.171320 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-38ae8d91-4336-4a06-8741-04b88f28d152 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:05.172254 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-38ae8d91-4336-4a06-8741-04b88f28d152 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:05.172254 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-38ae8d91-4336-4a06-8741-04b88f28d152 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:05.172929 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-38ae8d91-4336-4a06-8741-04b88f28d152 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:05.173384 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-38ae8d91-4336-4a06-8741-04b88f28d152 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:05.173812 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-38ae8d91-4336-4a06-8741-04b88f28d152 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:05.377853 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-38ae8d91-4336-4a06-8741-04b88f28d152 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:05.385761 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-38ae8d91-4336-4a06-8741-04b88f28d152 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb" status: 200 len: 1734 microversion: 2.1 time: 0.230376 Aug 06 14:36:05.386314 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 385/722] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:36:05 2022] GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb => generated 1734 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:36:06.406093 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-0c66b530-65b4-41b0-b57a-e845f4ea1b22 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:06.406703 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-0c66b530-65b4-41b0-b57a-e845f4ea1b22 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 8805d1fa-6d65-45c7-ae75-17e46feccccb] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:06.413150 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0c66b530-65b4-41b0-b57a-e845f4ea1b22 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:06.413637 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0c66b530-65b4-41b0-b57a-e845f4ea1b22 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:06.414068 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0c66b530-65b4-41b0-b57a-e845f4ea1b22 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:06.414755 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0c66b530-65b4-41b0-b57a-e845f4ea1b22 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:06.415234 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0c66b530-65b4-41b0-b57a-e845f4ea1b22 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:06.415658 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0c66b530-65b4-41b0-b57a-e845f4ea1b22 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:06.543938 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-0c66b530-65b4-41b0-b57a-e845f4ea1b22 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:06.551826 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-0c66b530-65b4-41b0-b57a-e845f4ea1b22 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb" status: 200 len: 1734 microversion: 2.1 time: 0.150207 Aug 06 14:36:06.552396 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 338/723] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:36:06 2022] GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:36:07.573553 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-f47dda31-1f38-4fdb-a7dc-795394479faf tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:07.574204 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-f47dda31-1f38-4fdb-a7dc-795394479faf tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 8805d1fa-6d65-45c7-ae75-17e46feccccb] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:07.581399 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f47dda31-1f38-4fdb-a7dc-795394479faf tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:07.581867 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f47dda31-1f38-4fdb-a7dc-795394479faf tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:07.582324 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f47dda31-1f38-4fdb-a7dc-795394479faf tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:07.583048 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f47dda31-1f38-4fdb-a7dc-795394479faf tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:07.583503 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f47dda31-1f38-4fdb-a7dc-795394479faf tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:07.583926 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f47dda31-1f38-4fdb-a7dc-795394479faf tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:07.710200 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-f47dda31-1f38-4fdb-a7dc-795394479faf tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:07.718764 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-f47dda31-1f38-4fdb-a7dc-795394479faf tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb" status: 200 len: 1734 microversion: 2.1 time: 0.149114 Aug 06 14:36:07.719302 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 386/724] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:36:07 2022] GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:36:08.739465 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-f5abaddc-bd3f-4f0d-bb4f-dd073d782a0e tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:08.740070 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-f5abaddc-bd3f-4f0d-bb4f-dd073d782a0e tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 8805d1fa-6d65-45c7-ae75-17e46feccccb] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:08.746401 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f5abaddc-bd3f-4f0d-bb4f-dd073d782a0e tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:08.746940 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f5abaddc-bd3f-4f0d-bb4f-dd073d782a0e tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:08.747377 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f5abaddc-bd3f-4f0d-bb4f-dd073d782a0e tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:08.748059 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f5abaddc-bd3f-4f0d-bb4f-dd073d782a0e tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:08.748512 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f5abaddc-bd3f-4f0d-bb4f-dd073d782a0e tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:08.748939 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f5abaddc-bd3f-4f0d-bb4f-dd073d782a0e tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:08.876562 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-f5abaddc-bd3f-4f0d-bb4f-dd073d782a0e tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:08.884392 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-f5abaddc-bd3f-4f0d-bb4f-dd073d782a0e tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb" status: 200 len: 1734 microversion: 2.1 time: 0.148789 Aug 06 14:36:08.884952 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 339/725] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:36:08 2022] GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:36:09.905160 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-16110fa4-f8b6-4af7-9c7e-ce6be965b7af tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:09.905770 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-16110fa4-f8b6-4af7-9c7e-ce6be965b7af tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 8805d1fa-6d65-45c7-ae75-17e46feccccb] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:09.912193 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-16110fa4-f8b6-4af7-9c7e-ce6be965b7af tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:09.912670 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-16110fa4-f8b6-4af7-9c7e-ce6be965b7af tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:09.913099 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-16110fa4-f8b6-4af7-9c7e-ce6be965b7af tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:09.913779 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-16110fa4-f8b6-4af7-9c7e-ce6be965b7af tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:09.914225 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-16110fa4-f8b6-4af7-9c7e-ce6be965b7af tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:09.914665 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-16110fa4-f8b6-4af7-9c7e-ce6be965b7af tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:10.041373 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-16110fa4-f8b6-4af7-9c7e-ce6be965b7af tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:10.049623 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-16110fa4-f8b6-4af7-9c7e-ce6be965b7af tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb" status: 200 len: 1734 microversion: 2.1 time: 0.148297 Aug 06 14:36:10.050178 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 387/726] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:36:09 2022] GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:36:11.070331 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-31370ebc-735f-4f5e-915a-2917a5e505f9 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:11.070961 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-31370ebc-735f-4f5e-915a-2917a5e505f9 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 8805d1fa-6d65-45c7-ae75-17e46feccccb] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:11.073497 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_api:SELECT=22 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:36:11.079744 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-31370ebc-735f-4f5e-915a-2917a5e505f9 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:11.080220 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-31370ebc-735f-4f5e-915a-2917a5e505f9 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:11.080651 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-31370ebc-735f-4f5e-915a-2917a5e505f9 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:11.081328 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-31370ebc-735f-4f5e-915a-2917a5e505f9 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:11.081780 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-31370ebc-735f-4f5e-915a-2917a5e505f9 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:11.082205 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-31370ebc-735f-4f5e-915a-2917a5e505f9 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:11.211277 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-31370ebc-735f-4f5e-915a-2917a5e505f9 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:11.219073 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-31370ebc-735f-4f5e-915a-2917a5e505f9 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb" status: 200 len: 1734 microversion: 2.1 time: 0.152517 Aug 06 14:36:11.219627 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 340/727] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:36:11 2022] GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:36:12.239893 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-bd90b41b-2ba3-4dec-9794-a1bdfd888d8f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:12.240490 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-bd90b41b-2ba3-4dec-9794-a1bdfd888d8f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 8805d1fa-6d65-45c7-ae75-17e46feccccb] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:12.246779 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-bd90b41b-2ba3-4dec-9794-a1bdfd888d8f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:12.247288 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-bd90b41b-2ba3-4dec-9794-a1bdfd888d8f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:12.247713 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-bd90b41b-2ba3-4dec-9794-a1bdfd888d8f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:12.248383 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-bd90b41b-2ba3-4dec-9794-a1bdfd888d8f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:12.248829 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-bd90b41b-2ba3-4dec-9794-a1bdfd888d8f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:12.249243 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-bd90b41b-2ba3-4dec-9794-a1bdfd888d8f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:12.378495 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-bd90b41b-2ba3-4dec-9794-a1bdfd888d8f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:12.386617 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-bd90b41b-2ba3-4dec-9794-a1bdfd888d8f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb" status: 200 len: 1734 microversion: 2.1 time: 0.150559 Aug 06 14:36:12.387702 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 388/728] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:36:12 2022] GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:36:13.408296 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-156fa9a8-efe3-4045-8995-898cc912d5f3 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:13.408929 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-156fa9a8-efe3-4045-8995-898cc912d5f3 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 8805d1fa-6d65-45c7-ae75-17e46feccccb] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:13.414960 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-156fa9a8-efe3-4045-8995-898cc912d5f3 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:13.415435 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-156fa9a8-efe3-4045-8995-898cc912d5f3 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:13.415862 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-156fa9a8-efe3-4045-8995-898cc912d5f3 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:13.416531 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-156fa9a8-efe3-4045-8995-898cc912d5f3 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:13.416976 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-156fa9a8-efe3-4045-8995-898cc912d5f3 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:13.417389 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-156fa9a8-efe3-4045-8995-898cc912d5f3 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:13.546334 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-156fa9a8-efe3-4045-8995-898cc912d5f3 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:13.554436 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-156fa9a8-efe3-4045-8995-898cc912d5f3 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb" status: 200 len: 1734 microversion: 2.1 time: 0.150084 Aug 06 14:36:13.555021 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 341/729] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:36:13 2022] GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:36:14.575180 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-34d79a11-70eb-441d-9711-5f0894119d1b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:14.575932 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-34d79a11-70eb-441d-9711-5f0894119d1b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 8805d1fa-6d65-45c7-ae75-17e46feccccb] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:14.582618 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-34d79a11-70eb-441d-9711-5f0894119d1b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:14.583215 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-34d79a11-70eb-441d-9711-5f0894119d1b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:14.583781 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-34d79a11-70eb-441d-9711-5f0894119d1b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:14.584333 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-34d79a11-70eb-441d-9711-5f0894119d1b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:14.584783 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-34d79a11-70eb-441d-9711-5f0894119d1b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:14.585214 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-34d79a11-70eb-441d-9711-5f0894119d1b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:14.669359 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-2606b8af-2d81-4832-9bbe-fc7e6af8437a tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:14.669854 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-2606b8af-2d81-4832-9bbe-fc7e6af8437a tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:14.675816 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2606b8af-2d81-4832-9bbe-fc7e6af8437a tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:14.676300 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2606b8af-2d81-4832-9bbe-fc7e6af8437a tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:14.676733 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2606b8af-2d81-4832-9bbe-fc7e6af8437a tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:14.677423 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2606b8af-2d81-4832-9bbe-fc7e6af8437a tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:14.677877 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2606b8af-2d81-4832-9bbe-fc7e6af8437a tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:14.678298 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2606b8af-2d81-4832-9bbe-fc7e6af8437a tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:14.716064 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-34d79a11-70eb-441d-9711-5f0894119d1b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:14.723935 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-34d79a11-70eb-441d-9711-5f0894119d1b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb" status: 200 len: 1734 microversion: 2.1 time: 0.152650 Aug 06 14:36:14.724494 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 342/730] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:36:14 2022] GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:36:14.801141 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.objects.instance [None req-2606b8af-2d81-4832-9bbe-fc7e6af8437a tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lazy-loading 'services' on Instance uuid 8b9f7623-548a-4f92-8f60-9d7ee92e0fac {{(pid=117837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 14:36:14.917170 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-2606b8af-2d81-4832-9bbe-fc7e6af8437a tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "DELETE /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac/os-volume_attachments/48ecd1ac-4d0b-4687-a221-e2423b6a8005" status: 202 len: 0 microversion: 2.1 time: 0.358141 Aug 06 14:36:14.917764 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 389/731] 10.222.0.17 () {58 vars in 1416 bytes} [Sat Aug 6 14:36:14 2022] DELETE /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac/os-volume_attachments/48ecd1ac-4d0b-4687-a221-e2423b6a8005 => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 14:36:15.745426 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-f2ea57d4-2a18-4ffc-b8cf-04b14f4f8ff4 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:15.746039 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-f2ea57d4-2a18-4ffc-b8cf-04b14f4f8ff4 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 8805d1fa-6d65-45c7-ae75-17e46feccccb] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:15.752842 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f2ea57d4-2a18-4ffc-b8cf-04b14f4f8ff4 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:15.753331 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f2ea57d4-2a18-4ffc-b8cf-04b14f4f8ff4 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:15.753780 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f2ea57d4-2a18-4ffc-b8cf-04b14f4f8ff4 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:15.754481 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f2ea57d4-2a18-4ffc-b8cf-04b14f4f8ff4 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:15.754960 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f2ea57d4-2a18-4ffc-b8cf-04b14f4f8ff4 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:15.755393 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f2ea57d4-2a18-4ffc-b8cf-04b14f4f8ff4 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:15.884954 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-f2ea57d4-2a18-4ffc-b8cf-04b14f4f8ff4 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:15.892910 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-f2ea57d4-2a18-4ffc-b8cf-04b14f4f8ff4 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb" status: 200 len: 1734 microversion: 2.1 time: 0.151373 Aug 06 14:36:15.893472 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 343/732] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:36:15 2022] GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:36:16.914465 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-88c248db-c57a-4290-b8ff-f54f5ee0422b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:16.915181 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-88c248db-c57a-4290-b8ff-f54f5ee0422b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 8805d1fa-6d65-45c7-ae75-17e46feccccb] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:16.917073 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_api:SELECT=22 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:36:16.923343 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-88c248db-c57a-4290-b8ff-f54f5ee0422b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:16.923820 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-88c248db-c57a-4290-b8ff-f54f5ee0422b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:16.924245 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-88c248db-c57a-4290-b8ff-f54f5ee0422b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:16.924927 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-88c248db-c57a-4290-b8ff-f54f5ee0422b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:16.925373 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-88c248db-c57a-4290-b8ff-f54f5ee0422b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:16.925790 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-88c248db-c57a-4290-b8ff-f54f5ee0422b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:16.928323 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:36:17.061130 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-88c248db-c57a-4290-b8ff-f54f5ee0422b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:17.069188 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-88c248db-c57a-4290-b8ff-f54f5ee0422b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb" status: 200 len: 1734 microversion: 2.1 time: 0.159349 Aug 06 14:36:17.069749 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 390/733] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:36:16 2022] GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:36:17.095156 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-0d09b78a-5bbd-4bbc-b5bb-da0abd9d60ae tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:36:17.103079 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0d09b78a-5bbd-4bbc-b5bb-da0abd9d60ae tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:17.103507 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0d09b78a-5bbd-4bbc-b5bb-da0abd9d60ae tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:17.103946 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0d09b78a-5bbd-4bbc-b5bb-da0abd9d60ae tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:17.163594 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-0d09b78a-5bbd-4bbc-b5bb-da0abd9d60ae tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Going to try to stop instance {{(pid=117838) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 06 14:36:17.210221 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-0d09b78a-5bbd-4bbc-b5bb-da0abd9d60ae tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "POST /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac/action" status: 202 len: 0 microversion: 2.1 time: 0.120028 Aug 06 14:36:17.210817 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 344/734] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Aug 6 14:36:17 2022] POST /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 14:36:17.218933 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-48f62fed-5a69-49c5-bcaf-c3c22977ea94 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:17.219610 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-48f62fed-5a69-49c5-bcaf-c3c22977ea94 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:17.225569 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-48f62fed-5a69-49c5-bcaf-c3c22977ea94 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:17.226125 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-48f62fed-5a69-49c5-bcaf-c3c22977ea94 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:17.226553 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-48f62fed-5a69-49c5-bcaf-c3c22977ea94 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:17.227252 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-48f62fed-5a69-49c5-bcaf-c3c22977ea94 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:17.227696 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-48f62fed-5a69-49c5-bcaf-c3c22977ea94 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:17.228110 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-48f62fed-5a69-49c5-bcaf-c3c22977ea94 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:17.364564 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-48f62fed-5a69-49c5-bcaf-c3c22977ea94 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:17.375037 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-48f62fed-5a69-49c5-bcaf-c3c22977ea94 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1676 microversion: 2.1 time: 0.159879 Aug 06 14:36:17.375667 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 391/735] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:36:17 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:36:18.091490 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-bfb02570-27ac-4f9c-9508-ac7bc63c81da tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:18.092178 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-bfb02570-27ac-4f9c-9508-ac7bc63c81da tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 8805d1fa-6d65-45c7-ae75-17e46feccccb] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:18.098259 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-bfb02570-27ac-4f9c-9508-ac7bc63c81da tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:18.098824 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-bfb02570-27ac-4f9c-9508-ac7bc63c81da tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:18.099112 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-bfb02570-27ac-4f9c-9508-ac7bc63c81da tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:18.099787 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-bfb02570-27ac-4f9c-9508-ac7bc63c81da tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:18.100232 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-bfb02570-27ac-4f9c-9508-ac7bc63c81da tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:18.100648 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-bfb02570-27ac-4f9c-9508-ac7bc63c81da tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:18.230558 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-bfb02570-27ac-4f9c-9508-ac7bc63c81da tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:18.238436 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-bfb02570-27ac-4f9c-9508-ac7bc63c81da tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb" status: 200 len: 1734 microversion: 2.1 time: 0.151788 Aug 06 14:36:18.239028 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 345/736] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:36:18 2022] GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:36:18.395525 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-b12d54ba-31c4-4ea4-bfff-393de276957c tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:18.396161 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-b12d54ba-31c4-4ea4-bfff-393de276957c tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:18.403103 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b12d54ba-31c4-4ea4-bfff-393de276957c tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:18.403585 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b12d54ba-31c4-4ea4-bfff-393de276957c tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:18.404015 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b12d54ba-31c4-4ea4-bfff-393de276957c tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:18.404695 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b12d54ba-31c4-4ea4-bfff-393de276957c tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:18.405142 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b12d54ba-31c4-4ea4-bfff-393de276957c tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:18.405560 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b12d54ba-31c4-4ea4-bfff-393de276957c tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:18.532968 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-b12d54ba-31c4-4ea4-bfff-393de276957c tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:18.540496 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-b12d54ba-31c4-4ea4-bfff-393de276957c tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1676 microversion: 2.1 time: 0.148703 Aug 06 14:36:18.541060 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 392/737] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:36:18 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1676 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:36:19.259289 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-d5498896-b16f-4192-8492-03df10f3fb5f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:19.260158 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-d5498896-b16f-4192-8492-03df10f3fb5f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 8805d1fa-6d65-45c7-ae75-17e46feccccb] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:19.266415 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d5498896-b16f-4192-8492-03df10f3fb5f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:19.266923 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d5498896-b16f-4192-8492-03df10f3fb5f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:19.267356 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d5498896-b16f-4192-8492-03df10f3fb5f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:19.268034 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d5498896-b16f-4192-8492-03df10f3fb5f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:19.268486 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d5498896-b16f-4192-8492-03df10f3fb5f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:19.268906 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d5498896-b16f-4192-8492-03df10f3fb5f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:19.397940 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-d5498896-b16f-4192-8492-03df10f3fb5f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:19.406239 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-d5498896-b16f-4192-8492-03df10f3fb5f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb" status: 200 len: 1734 microversion: 2.1 time: 0.150760 Aug 06 14:36:19.406785 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 346/738] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:36:19 2022] GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:36:19.561292 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-b94424a5-700c-4f7b-acd7-d38da95df525 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:19.561819 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-b94424a5-700c-4f7b-acd7-d38da95df525 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:19.568093 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b94424a5-700c-4f7b-acd7-d38da95df525 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:19.568555 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b94424a5-700c-4f7b-acd7-d38da95df525 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:19.568982 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b94424a5-700c-4f7b-acd7-d38da95df525 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:19.569656 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b94424a5-700c-4f7b-acd7-d38da95df525 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:19.570103 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b94424a5-700c-4f7b-acd7-d38da95df525 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:19.570518 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b94424a5-700c-4f7b-acd7-d38da95df525 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:19.700387 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-b94424a5-700c-4f7b-acd7-d38da95df525 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:19.707738 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-b94424a5-700c-4f7b-acd7-d38da95df525 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1676 microversion: 2.1 time: 0.150649 Aug 06 14:36:19.708291 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 393/739] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:36:19 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:36:20.436580 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-2aa2a8c5-2608-4c25-943b-2e759e6956bd tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:20.437182 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-2aa2a8c5-2608-4c25-943b-2e759e6956bd tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 8805d1fa-6d65-45c7-ae75-17e46feccccb] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:20.444184 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2aa2a8c5-2608-4c25-943b-2e759e6956bd tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:20.444664 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2aa2a8c5-2608-4c25-943b-2e759e6956bd tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:20.445096 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2aa2a8c5-2608-4c25-943b-2e759e6956bd tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:20.445784 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2aa2a8c5-2608-4c25-943b-2e759e6956bd tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:20.446236 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2aa2a8c5-2608-4c25-943b-2e759e6956bd tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:20.446658 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2aa2a8c5-2608-4c25-943b-2e759e6956bd tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:20.578249 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-2aa2a8c5-2608-4c25-943b-2e759e6956bd tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:20.580842 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:36:20.588271 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-2aa2a8c5-2608-4c25-943b-2e759e6956bd tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb" status: 200 len: 1734 microversion: 2.1 time: 0.155455 Aug 06 14:36:20.588836 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 347/740] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:36:20 2022] GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:36:20.729642 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-d33ce3d8-c691-41c3-95fb-96d27c807bdd tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:20.730279 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-d33ce3d8-c691-41c3-95fb-96d27c807bdd tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:20.737256 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d33ce3d8-c691-41c3-95fb-96d27c807bdd tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:20.737738 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d33ce3d8-c691-41c3-95fb-96d27c807bdd tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:20.738171 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d33ce3d8-c691-41c3-95fb-96d27c807bdd tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:20.738858 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d33ce3d8-c691-41c3-95fb-96d27c807bdd tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:20.739335 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d33ce3d8-c691-41c3-95fb-96d27c807bdd tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:20.739759 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d33ce3d8-c691-41c3-95fb-96d27c807bdd tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:20.870189 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-d33ce3d8-c691-41c3-95fb-96d27c807bdd tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:20.877854 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-d33ce3d8-c691-41c3-95fb-96d27c807bdd tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1676 microversion: 2.1 time: 0.152063 Aug 06 14:36:20.878413 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 394/741] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:36:20 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:36:21.608033 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-14850c2b-e97d-4a35-b0eb-d37107657e4b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:21.608628 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-14850c2b-e97d-4a35-b0eb-d37107657e4b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 8805d1fa-6d65-45c7-ae75-17e46feccccb] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:21.616477 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-14850c2b-e97d-4a35-b0eb-d37107657e4b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:21.616953 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-14850c2b-e97d-4a35-b0eb-d37107657e4b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:21.617382 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-14850c2b-e97d-4a35-b0eb-d37107657e4b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:21.618064 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-14850c2b-e97d-4a35-b0eb-d37107657e4b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:21.618512 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-14850c2b-e97d-4a35-b0eb-d37107657e4b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:21.618963 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-14850c2b-e97d-4a35-b0eb-d37107657e4b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:21.748739 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-14850c2b-e97d-4a35-b0eb-d37107657e4b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:21.756573 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-14850c2b-e97d-4a35-b0eb-d37107657e4b tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb" status: 200 len: 1734 microversion: 2.1 time: 0.152381 Aug 06 14:36:21.757131 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 348/742] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:36:21 2022] GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:36:21.897602 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-9e97d049-c519-4ffa-b2b7-bd0178a3317a tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:21.898217 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-9e97d049-c519-4ffa-b2b7-bd0178a3317a tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:21.904739 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9e97d049-c519-4ffa-b2b7-bd0178a3317a tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:21.905218 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9e97d049-c519-4ffa-b2b7-bd0178a3317a tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:21.905660 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9e97d049-c519-4ffa-b2b7-bd0178a3317a tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:21.906349 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9e97d049-c519-4ffa-b2b7-bd0178a3317a tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:21.907150 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9e97d049-c519-4ffa-b2b7-bd0178a3317a tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:21.907904 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9e97d049-c519-4ffa-b2b7-bd0178a3317a tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:22.038298 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-9e97d049-c519-4ffa-b2b7-bd0178a3317a tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:22.046255 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-9e97d049-c519-4ffa-b2b7-bd0178a3317a tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1676 microversion: 2.1 time: 0.152465 Aug 06 14:36:22.046812 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 395/743] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:36:21 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:36:22.778155 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-2afc0080-4a13-48f0-b1fa-04dbe6a64780 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:22.778795 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-2afc0080-4a13-48f0-b1fa-04dbe6a64780 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 8805d1fa-6d65-45c7-ae75-17e46feccccb] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:22.785769 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2afc0080-4a13-48f0-b1fa-04dbe6a64780 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:22.786251 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2afc0080-4a13-48f0-b1fa-04dbe6a64780 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:22.786676 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2afc0080-4a13-48f0-b1fa-04dbe6a64780 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:22.787394 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2afc0080-4a13-48f0-b1fa-04dbe6a64780 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:22.787840 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2afc0080-4a13-48f0-b1fa-04dbe6a64780 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:22.788255 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2afc0080-4a13-48f0-b1fa-04dbe6a64780 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:22.916236 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-2afc0080-4a13-48f0-b1fa-04dbe6a64780 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:22.924117 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-2afc0080-4a13-48f0-b1fa-04dbe6a64780 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb" status: 200 len: 1714 microversion: 2.1 time: 0.149811 Aug 06 14:36:22.924677 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 349/744] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:36:22 2022] GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb => generated 1714 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:36:22.984553 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-4a0ab450-96e4-40cc-a6d4-342c18dbd537 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:22.985142 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-4a0ab450-96e4-40cc-a6d4-342c18dbd537 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 8805d1fa-6d65-45c7-ae75-17e46feccccb] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:22.991492 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-4a0ab450-96e4-40cc-a6d4-342c18dbd537 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:22.991969 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-4a0ab450-96e4-40cc-a6d4-342c18dbd537 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:22.992401 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-4a0ab450-96e4-40cc-a6d4-342c18dbd537 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:22.993084 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-4a0ab450-96e4-40cc-a6d4-342c18dbd537 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:22.993532 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-4a0ab450-96e4-40cc-a6d4-342c18dbd537 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:22.993956 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-4a0ab450-96e4-40cc-a6d4-342c18dbd537 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:23.067666 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-e581114f-26a8-4707-9eb9-757630d07bbe tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:23.068282 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-e581114f-26a8-4707-9eb9-757630d07bbe tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:23.072859 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.wsgi [None req-4a0ab450-96e4-40cc-a6d4-342c18dbd537 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] HTTP exception thrown: Cannot 'detach_volume' instance 8805d1fa-6d65-45c7-ae75-17e46feccccb while it is in vm_state rescued Aug 06 14:36:23.074050 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e581114f-26a8-4707-9eb9-757630d07bbe tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:23.075038 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-4a0ab450-96e4-40cc-a6d4-342c18dbd537 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Request method failure captured: Aug 06 14:36:23.075038 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: request: DELETE /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb/os-volume_attachments/e5569621-03ca-4d10-9cd6-fc59ef122000 HTTP/1.1 Aug 06 14:36:23.075038 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Accept: application/json Aug 06 14:36:23.075038 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Accept-Encoding: identity Aug 06 14:36:23.075038 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Connection: close Aug 06 14:36:23.075038 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Content-Length: 0 Aug 06 14:36:23.075038 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Content-Type: application/json Aug 06 14:36:23.075038 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Host: 10.222.0.17 Aug 06 14:36:23.075038 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Openstack-System-Scope: None Aug 06 14:36:23.075038 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: User-Agent: python-urllib3/1.26.11 Aug 06 14:36:23.075038 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Auth-Token: gAAAAABi7nreTiAQh7OGccJzMvpg6S4oeq9E7_giKG29ZsuQVMckwBo811MoZtHu7-VetjuRk3nZzucmu63Ww280erpCJunGj07pbSJnl4FV9pUrtMmgxWxHn25usemMXgtqgjhvbLrZ7mNdr87us3X1_BnoBfsvObjRpmug3z5gc_PZHaYrCyc Aug 06 14:36:23.075038 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Domain-Id: None Aug 06 14:36:23.075038 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Domain-Name: None Aug 06 14:36:23.075038 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Identity-Status: Confirmed Aug 06 14:36:23.075038 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Is-Admin-Project: True Aug 06 14:36:23.075038 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Domain-Id: default Aug 06 14:36:23.075038 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Domain-Name: Default Aug 06 14:36:23.075038 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Id: d19dc46cdcf549b0a6383c8b99d6f15f Aug 06 14:36:23.075038 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-379070379 Aug 06 14:36:23.075038 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Role: member,reader Aug 06 14:36:23.075038 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Roles: member,reader Aug 06 14:36:23.076431 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d19dc46cdcf549b0a6383c8b99d6f15f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d19dc46cdcf549b0a6383c8b99d6f15f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d19dc46cdcf549b0a6383c8b99d6f15f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d19dc46cdcf549b0a6383c8b99d6f15f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 06 14:36:23.076431 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant: tempest-ServerRescueNegativeTestJSON-379070379 Aug 06 14:36:23.076431 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant-Id: d19dc46cdcf549b0a6383c8b99d6f15f Aug 06 14:36:23.076431 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-379070379 Aug 06 14:36:23.076431 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User: tempest-ServerRescueNegativeTestJSON-379070379-project Aug 06 14:36:23.076431 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Domain-Id: default Aug 06 14:36:23.076431 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Domain-Name: Default Aug 06 14:36:23.076431 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Id: 4dadf737392d4153ae50de020534f070 Aug 06 14:36:23.076431 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Name: tempest-ServerRescueNegativeTestJSON-379070379-project Aug 06 14:36:23.076431 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: method: > Aug 06 14:36:23.076431 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: exception: Cannot 'detach_volume' instance 8805d1fa-6d65-45c7-ae75-17e46feccccb while it is in vm_state rescued Aug 06 14:36:23.077105 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: action_args: {'server_id': '8805d1fa-6d65-45c7-ae75-17e46feccccb', 'id': 'e5569621-03ca-4d10-9cd6-fc59ef122000'} Aug 06 14:36:23.077105 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 14:36:23.077105 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:36:23.077105 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 06 14:36:23.077105 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 06 14:36:23.077105 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 06 14:36:23.077105 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 06 14:36:23.077105 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 06 14:36:23.077105 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 06 14:36:23.077105 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8805d1fa-6d65-45c7-ae75-17e46feccccb in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 06 14:36:23.077105 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:36:23.077105 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:36:23.077105 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:36:23.077105 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:36:23.077105 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:36:23.077105 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:36:23.077105 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 14:36:23.077105 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 14:36:23.077105 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 14:36:23.077105 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 14:36:23.078594 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 06 14:36:23.078594 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 06 14:36:23.078594 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 06 14:36:23.078594 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 06 14:36:23.078594 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 8805d1fa-6d65-45c7-ae75-17e46feccccb while it is in vm_state rescued Aug 06 14:36:23.078594 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:36:23.078594 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:36:23.078594 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:36:23.078594 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:36:23.078594 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:36:23.078594 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:36:23.078594 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 14:36:23.078594 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 14:36:23.078594 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 8805d1fa-6d65-45c7-ae75-17e46feccccb while it is in vm_state rescued Aug 06 14:36:23.078594 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:36:23.079921 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e581114f-26a8-4707-9eb9-757630d07bbe tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:23.079921 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e581114f-26a8-4707-9eb9-757630d07bbe tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:23.080125 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-4a0ab450-96e4-40cc-a6d4-342c18dbd537 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Returning 409 to user: Cannot 'detach_volume' instance 8805d1fa-6d65-45c7-ae75-17e46feccccb while it is in vm_state rescued {{(pid=117837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 14:36:23.080212 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e581114f-26a8-4707-9eb9-757630d07bbe tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:23.080287 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-4a0ab450-96e4-40cc-a6d4-342c18dbd537 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "DELETE /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb/os-volume_attachments/e5569621-03ca-4d10-9cd6-fc59ef122000" status: 409 len: 152 microversion: 2.1 time: 0.095849 Aug 06 14:36:23.080410 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e581114f-26a8-4707-9eb9-757630d07bbe tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:23.080533 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 396/745] 10.222.0.17 () {58 vars in 1416 bytes} [Sat Aug 6 14:36:22 2022] DELETE /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb/os-volume_attachments/e5569621-03ca-4d10-9cd6-fc59ef122000 => generated 152 bytes in 97 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 06 14:36:23.080629 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e581114f-26a8-4707-9eb9-757630d07bbe tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:23.085074 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-82e8c401-0875-45db-bc08-0e0b91124784 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:36:23.085598 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-82e8c401-0875-45db-bc08-0e0b91124784 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 8805d1fa-6d65-45c7-ae75-17e46feccccb] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:23.091290 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-82e8c401-0875-45db-bc08-0e0b91124784 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:23.091775 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-82e8c401-0875-45db-bc08-0e0b91124784 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:23.092235 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-82e8c401-0875-45db-bc08-0e0b91124784 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:23.092925 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-82e8c401-0875-45db-bc08-0e0b91124784 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:23.093377 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-82e8c401-0875-45db-bc08-0e0b91124784 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:23.093801 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-82e8c401-0875-45db-bc08-0e0b91124784 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:23.161314 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-82e8c401-0875-45db-bc08-0e0b91124784 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "POST /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb/action" status: 202 len: 0 microversion: 2.1 time: 0.079650 Aug 06 14:36:23.162193 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 397/746] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Aug 6 14:36:23 2022] POST /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 14:36:23.170227 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-72c111f9-3cc0-4771-8987-ea12b3c4604a tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:23.170942 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-72c111f9-3cc0-4771-8987-ea12b3c4604a tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 8805d1fa-6d65-45c7-ae75-17e46feccccb] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:23.177248 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-72c111f9-3cc0-4771-8987-ea12b3c4604a tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:23.177757 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-72c111f9-3cc0-4771-8987-ea12b3c4604a tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:23.178187 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-72c111f9-3cc0-4771-8987-ea12b3c4604a tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:23.178899 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-72c111f9-3cc0-4771-8987-ea12b3c4604a tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:23.179350 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-72c111f9-3cc0-4771-8987-ea12b3c4604a tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:23.179768 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-72c111f9-3cc0-4771-8987-ea12b3c4604a tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:23.213210 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-e581114f-26a8-4707-9eb9-757630d07bbe tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:23.220907 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-e581114f-26a8-4707-9eb9-757630d07bbe tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1676 microversion: 2.1 time: 0.157149 Aug 06 14:36:23.221474 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 350/747] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:36:23 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:36:23.318821 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-72c111f9-3cc0-4771-8987-ea12b3c4604a tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:23.326734 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-72c111f9-3cc0-4771-8987-ea12b3c4604a tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb" status: 200 len: 1722 microversion: 2.1 time: 0.160376 Aug 06 14:36:23.327316 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 398/748] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:36:23 2022] GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:36:24.241562 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-2178aa09-2341-42a3-b1a5-9dc07ed75a54 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:24.242166 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-2178aa09-2341-42a3-b1a5-9dc07ed75a54 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:24.248710 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2178aa09-2341-42a3-b1a5-9dc07ed75a54 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:24.249195 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2178aa09-2341-42a3-b1a5-9dc07ed75a54 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:24.249624 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2178aa09-2341-42a3-b1a5-9dc07ed75a54 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:24.250307 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2178aa09-2341-42a3-b1a5-9dc07ed75a54 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:24.250757 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2178aa09-2341-42a3-b1a5-9dc07ed75a54 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:24.251205 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2178aa09-2341-42a3-b1a5-9dc07ed75a54 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:24.346986 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-38eff1b7-5211-4b70-9f7c-f96a0e9c1535 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:24.347601 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-38eff1b7-5211-4b70-9f7c-f96a0e9c1535 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 8805d1fa-6d65-45c7-ae75-17e46feccccb] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:24.353813 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-38eff1b7-5211-4b70-9f7c-f96a0e9c1535 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:24.354293 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-38eff1b7-5211-4b70-9f7c-f96a0e9c1535 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:24.354728 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-38eff1b7-5211-4b70-9f7c-f96a0e9c1535 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:24.355444 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-38eff1b7-5211-4b70-9f7c-f96a0e9c1535 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:24.355898 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-38eff1b7-5211-4b70-9f7c-f96a0e9c1535 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:24.356318 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-38eff1b7-5211-4b70-9f7c-f96a0e9c1535 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:24.381152 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-2178aa09-2341-42a3-b1a5-9dc07ed75a54 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:24.389158 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-2178aa09-2341-42a3-b1a5-9dc07ed75a54 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1676 microversion: 2.1 time: 0.151446 Aug 06 14:36:24.389719 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 351/749] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:36:24 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:36:24.484737 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-38eff1b7-5211-4b70-9f7c-f96a0e9c1535 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:24.492663 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-38eff1b7-5211-4b70-9f7c-f96a0e9c1535 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb" status: 200 len: 1722 microversion: 2.1 time: 0.149502 Aug 06 14:36:24.493145 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 399/750] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:36:24 2022] GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:36:25.098085 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-6a1839e2-daa4-4e02-ac11-197586b4fea4 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:25.098524 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-6a1839e2-daa4-4e02-ac11-197586b4fea4 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 5a1c9667-a38f-471a-a735-b5dff6828a51] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:25.104280 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6a1839e2-daa4-4e02-ac11-197586b4fea4 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:25.104746 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6a1839e2-daa4-4e02-ac11-197586b4fea4 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:25.105169 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6a1839e2-daa4-4e02-ac11-197586b4fea4 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:25.106327 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6a1839e2-daa4-4e02-ac11-197586b4fea4 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:25.106771 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6a1839e2-daa4-4e02-ac11-197586b4fea4 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:25.107210 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6a1839e2-daa4-4e02-ac11-197586b4fea4 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:25.129796 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-6a1839e2-daa4-4e02-ac11-197586b4fea4 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51/ips" status: 200 len: 148 microversion: 2.1 time: 0.133713 Aug 06 14:36:25.130344 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 352/751] 10.222.0.17 () {58 vars in 1248 bytes} [Sat Aug 6 14:36:24 2022] GET /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51/ips => generated 148 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:36:25.141427 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-c9c783c0-125f-499b-963a-de280e472084 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9e8a5fc3-29f8-4032-ac5f-a0c16cb37485"}} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:36:25.143833 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-c9c783c0-125f-499b-963a-de280e472084 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 5a1c9667-a38f-471a-a735-b5dff6828a51] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:25.149747 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c9c783c0-125f-499b-963a-de280e472084 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:25.150219 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c9c783c0-125f-499b-963a-de280e472084 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:25.150644 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c9c783c0-125f-499b-963a-de280e472084 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:25.151339 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c9c783c0-125f-499b-963a-de280e472084 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:25.151787 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c9c783c0-125f-499b-963a-de280e472084 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:25.152707 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c9c783c0-125f-499b-963a-de280e472084 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:25.228941 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.wsgi [None req-c9c783c0-125f-499b-963a-de280e472084 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] HTTP exception thrown: Invalid volume: volume 9e8a5fc3-29f8-4032-ac5f-a0c16cb37485 is already attached to instances: 6e717f01-c854-444e-9872-51e2c1c78987 Aug 06 14:36:25.231327 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-c9c783c0-125f-499b-963a-de280e472084 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Request method failure captured: Aug 06 14:36:25.231327 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: request: POST /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51/os-volume_attachments HTTP/1.1 Aug 06 14:36:25.231327 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Accept: application/json Aug 06 14:36:25.231327 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Accept-Encoding: identity Aug 06 14:36:25.231327 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Connection: close Aug 06 14:36:25.231327 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Content-Length: 74 Aug 06 14:36:25.231327 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Content-Type: application/json Aug 06 14:36:25.231327 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Host: 10.222.0.17 Aug 06 14:36:25.231327 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Openstack-System-Scope: None Aug 06 14:36:25.231327 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: User-Agent: python-urllib3/1.26.11 Aug 06 14:36:25.231327 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Auth-Token: gAAAAABi7nrw1j_Ge2Ur2tEojXwBmjEDUihl-N8v1g20aSIVDaeL_OTgCZQS1IFihI0AmtEC1h-SgLRiudvycNkR7KjoTpqo7M5425d9Dy_4zXKbCfizwmIbraJL9PsVC3rQgInSWh6L4pF_pLJlUkvGCOVZ6ElDrY4gMQsJ7uwAoVwYy3EWJq0 Aug 06 14:36:25.231327 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Domain-Id: None Aug 06 14:36:25.231327 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Domain-Name: None Aug 06 14:36:25.231327 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Identity-Status: Confirmed Aug 06 14:36:25.231327 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Is-Admin-Project: True Aug 06 14:36:25.231327 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Domain-Id: default Aug 06 14:36:25.231327 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Domain-Name: Default Aug 06 14:36:25.231327 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Id: 96a7bb12d3ed4d1db2a58a03472483c2 Aug 06 14:36:25.231327 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Name: tempest-AttachVolumeNegativeTest-927490997 Aug 06 14:36:25.231327 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Role: member,reader Aug 06 14:36:25.231327 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Roles: member,reader Aug 06 14:36:25.232865 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/96a7bb12d3ed4d1db2a58a03472483c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/96a7bb12d3ed4d1db2a58a03472483c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_96a7bb12d3ed4d1db2a58a03472483c2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/96a7bb12d3ed4d1db2a58a03472483c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 06 14:36:25.232865 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant: tempest-AttachVolumeNegativeTest-927490997 Aug 06 14:36:25.232865 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant-Id: 96a7bb12d3ed4d1db2a58a03472483c2 Aug 06 14:36:25.232865 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-927490997 Aug 06 14:36:25.232865 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User: tempest-AttachVolumeNegativeTest-927490997-project Aug 06 14:36:25.232865 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Domain-Id: default Aug 06 14:36:25.232865 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Domain-Name: Default Aug 06 14:36:25.232865 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Id: 5378c85cd31c42dfbc39ce738a8b6dde Aug 06 14:36:25.232865 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Name: tempest-AttachVolumeNegativeTest-927490997-project Aug 06 14:36:25.232865 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Aug 06 14:36:25.232865 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: {"volumeAttachment": {"volumeId": "9e8a5fc3-29f8-4032-ac5f-a0c16cb37485"}} Aug 06 14:36:25.232865 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: method: > Aug 06 14:36:25.233753 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: exception: Invalid volume: volume 9e8a5fc3-29f8-4032-ac5f-a0c16cb37485 is already attached to instances: 6e717f01-c854-444e-9872-51e2c1c78987 Aug 06 14:36:25.233753 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: action_args: {'server_id': '5a1c9667-a38f-471a-a735-b5dff6828a51', 'body': {'volumeAttachment': {'volumeId': '9e8a5fc3-29f8-4032-ac5f-a0c16cb37485'}}} Aug 06 14:36:25.233753 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 14:36:25.233753 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:36:25.233753 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 06 14:36:25.233753 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 06 14:36:25.233753 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 06 14:36:25.233753 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 06 14:36:25.233753 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 06 14:36:25.233753 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 06 14:36:25.233753 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 06 14:36:25.233753 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 06 14:36:25.233753 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 06 14:36:25.233753 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 06 14:36:25.233753 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 9e8a5fc3-29f8-4032-ac5f-a0c16cb37485 is already attached to instances: 6e717f01-c854-444e-9872-51e2c1c78987 Aug 06 14:36:25.233753 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:36:25.233753 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:36:25.233753 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:36:25.233753 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:36:25.234920 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:36:25.234920 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:36:25.234920 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 14:36:25.234920 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 14:36:25.234920 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 14:36:25.234920 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 14:36:25.234920 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 14:36:25.234920 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 14:36:25.234920 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 14:36:25.234920 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 14:36:25.234920 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 14:36:25.234920 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 14:36:25.234920 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 06 14:36:25.234920 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 06 14:36:25.234920 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 9e8a5fc3-29f8-4032-ac5f-a0c16cb37485 is already attached to instances: 6e717f01-c854-444e-9872-51e2c1c78987 Aug 06 14:36:25.234920 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:36:25.234920 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:36:25.234920 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:36:25.234920 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:36:25.234920 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:36:25.236109 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:36:25.236109 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 14:36:25.236109 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 14:36:25.236109 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 9e8a5fc3-29f8-4032-ac5f-a0c16cb37485 is already attached to instances: 6e717f01-c854-444e-9872-51e2c1c78987 Aug 06 14:36:25.236109 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:36:25.236109 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-c9c783c0-125f-499b-963a-de280e472084 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Returning 400 to user: Invalid volume: volume 9e8a5fc3-29f8-4032-ac5f-a0c16cb37485 is already attached to instances: 6e717f01-c854-444e-9872-51e2c1c78987 {{(pid=117837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 14:36:25.236109 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-c9c783c0-125f-499b-963a-de280e472084 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "POST /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095241 Aug 06 14:36:25.236109 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 400/752] 10.222.0.17 () {60 vars in 1323 bytes} [Sat Aug 6 14:36:25 2022] POST /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51/os-volume_attachments => generated 174 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 06 14:36:25.242551 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-c159cafc-6487-481a-a9b4-6a090631d08f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:25.243083 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-c159cafc-6487-481a-a9b4-6a090631d08f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 5a1c9667-a38f-471a-a735-b5dff6828a51] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:25.249402 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c159cafc-6487-481a-a9b4-6a090631d08f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:25.249875 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c159cafc-6487-481a-a9b4-6a090631d08f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:25.250306 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c159cafc-6487-481a-a9b4-6a090631d08f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:25.251022 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c159cafc-6487-481a-a9b4-6a090631d08f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:25.251474 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c159cafc-6487-481a-a9b4-6a090631d08f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:25.251890 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c159cafc-6487-481a-a9b4-6a090631d08f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:25.277788 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-c159cafc-6487-481a-a9b4-6a090631d08f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 5a1c9667-a38f-471a-a735-b5dff6828a51] Going to try to terminate instance {{(pid=117838) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 14:36:25.351867 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-c159cafc-6487-481a-a9b4-6a090631d08f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51" status: 204 len: 0 microversion: 2.1 time: 0.112698 Aug 06 14:36:25.352364 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 353/753] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Aug 6 14:36:25 2022] DELETE /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 14:36:25.361269 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-1ebd6f0a-0057-48fb-b7ca-5e4e4f9c2ade tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:25.361879 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-1ebd6f0a-0057-48fb-b7ca-5e4e4f9c2ade tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 5a1c9667-a38f-471a-a735-b5dff6828a51] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:25.368917 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1ebd6f0a-0057-48fb-b7ca-5e4e4f9c2ade tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:25.369398 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1ebd6f0a-0057-48fb-b7ca-5e4e4f9c2ade tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:25.369832 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1ebd6f0a-0057-48fb-b7ca-5e4e4f9c2ade tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:25.370515 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1ebd6f0a-0057-48fb-b7ca-5e4e4f9c2ade tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:25.371032 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1ebd6f0a-0057-48fb-b7ca-5e4e4f9c2ade tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:25.371459 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1ebd6f0a-0057-48fb-b7ca-5e4e4f9c2ade tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:25.411275 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-2ac08632-12f3-43f5-9582-1c351e3b13cd tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:25.412105 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-2ac08632-12f3-43f5-9582-1c351e3b13cd tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:25.418527 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2ac08632-12f3-43f5-9582-1c351e3b13cd tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:25.419030 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2ac08632-12f3-43f5-9582-1c351e3b13cd tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:25.419457 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2ac08632-12f3-43f5-9582-1c351e3b13cd tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:25.420146 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2ac08632-12f3-43f5-9582-1c351e3b13cd tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:25.420593 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2ac08632-12f3-43f5-9582-1c351e3b13cd tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:25.421007 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2ac08632-12f3-43f5-9582-1c351e3b13cd tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:25.499023 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-1ebd6f0a-0057-48fb-b7ca-5e4e4f9c2ade tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:25.506578 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-1ebd6f0a-0057-48fb-b7ca-5e4e4f9c2ade tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51" status: 200 len: 1679 microversion: 2.1 time: 0.149082 Aug 06 14:36:25.520337 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 401/754] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:36:25 2022] GET /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51 => generated 1679 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:36:25.520337 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-5c69c2d1-61be-4eac-8fa6-832fad2bc524 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:25.520337 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-5c69c2d1-61be-4eac-8fa6-832fad2bc524 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 8805d1fa-6d65-45c7-ae75-17e46feccccb] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:25.520337 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-5c69c2d1-61be-4eac-8fa6-832fad2bc524 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:25.520795 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-5c69c2d1-61be-4eac-8fa6-832fad2bc524 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:25.520890 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-5c69c2d1-61be-4eac-8fa6-832fad2bc524 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:25.521528 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-5c69c2d1-61be-4eac-8fa6-832fad2bc524 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:25.521978 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-5c69c2d1-61be-4eac-8fa6-832fad2bc524 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:25.522393 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-5c69c2d1-61be-4eac-8fa6-832fad2bc524 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:25.549009 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-2ac08632-12f3-43f5-9582-1c351e3b13cd tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:25.556528 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-2ac08632-12f3-43f5-9582-1c351e3b13cd tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1676 microversion: 2.1 time: 0.149414 Aug 06 14:36:25.557347 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 354/755] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:36:25 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:36:25.653159 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-5c69c2d1-61be-4eac-8fa6-832fad2bc524 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:25.660914 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-5c69c2d1-61be-4eac-8fa6-832fad2bc524 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb" status: 200 len: 1722 microversion: 2.1 time: 0.151455 Aug 06 14:36:25.661467 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 402/756] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:36:25 2022] GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:36:26.528123 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-03028fea-d67e-4180-a671-cad631dca70b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:26.528727 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-03028fea-d67e-4180-a671-cad631dca70b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 5a1c9667-a38f-471a-a735-b5dff6828a51] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:26.535143 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-03028fea-d67e-4180-a671-cad631dca70b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:26.535609 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-03028fea-d67e-4180-a671-cad631dca70b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:26.536039 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-03028fea-d67e-4180-a671-cad631dca70b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:26.536716 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-03028fea-d67e-4180-a671-cad631dca70b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:26.537166 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-03028fea-d67e-4180-a671-cad631dca70b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:26.537585 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-03028fea-d67e-4180-a671-cad631dca70b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:26.577313 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-0978f9f6-6168-4fa5-be74-78330fb5db45 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:26.577919 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-0978f9f6-6168-4fa5-be74-78330fb5db45 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:26.584788 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0978f9f6-6168-4fa5-be74-78330fb5db45 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:26.585276 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0978f9f6-6168-4fa5-be74-78330fb5db45 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:26.585738 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0978f9f6-6168-4fa5-be74-78330fb5db45 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:26.586461 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0978f9f6-6168-4fa5-be74-78330fb5db45 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:26.586970 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0978f9f6-6168-4fa5-be74-78330fb5db45 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:26.587394 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0978f9f6-6168-4fa5-be74-78330fb5db45 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:26.671277 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-03028fea-d67e-4180-a671-cad631dca70b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:26.678981 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-03028fea-d67e-4180-a671-cad631dca70b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51" status: 200 len: 1679 microversion: 2.1 time: 0.154701 Aug 06 14:36:26.679552 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 355/757] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:36:26 2022] GET /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:36:26.685867 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-6d79ae93-673b-43b2-8909-6bb8d1d05127 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:26.685867 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-6d79ae93-673b-43b2-8909-6bb8d1d05127 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 8805d1fa-6d65-45c7-ae75-17e46feccccb] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:26.690478 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6d79ae93-673b-43b2-8909-6bb8d1d05127 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:26.691029 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6d79ae93-673b-43b2-8909-6bb8d1d05127 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:26.691417 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6d79ae93-673b-43b2-8909-6bb8d1d05127 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:26.692577 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6d79ae93-673b-43b2-8909-6bb8d1d05127 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:26.692577 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6d79ae93-673b-43b2-8909-6bb8d1d05127 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:26.692959 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6d79ae93-673b-43b2-8909-6bb8d1d05127 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:26.717736 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-0978f9f6-6168-4fa5-be74-78330fb5db45 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:26.725478 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-0978f9f6-6168-4fa5-be74-78330fb5db45 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1676 microversion: 2.1 time: 0.152072 Aug 06 14:36:26.726166 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 403/758] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:36:26 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:36:26.820930 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-6d79ae93-673b-43b2-8909-6bb8d1d05127 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:26.831295 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-6d79ae93-673b-43b2-8909-6bb8d1d05127 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb" status: 200 len: 1722 microversion: 2.1 time: 0.150723 Aug 06 14:36:26.831859 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 356/759] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:36:26 2022] GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:36:27.700230 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-a164c693-0ae8-4005-b5ed-0cca796ad287 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:27.700855 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-a164c693-0ae8-4005-b5ed-0cca796ad287 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 5a1c9667-a38f-471a-a735-b5dff6828a51] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:27.707266 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a164c693-0ae8-4005-b5ed-0cca796ad287 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:27.707741 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a164c693-0ae8-4005-b5ed-0cca796ad287 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:27.708166 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a164c693-0ae8-4005-b5ed-0cca796ad287 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:27.708848 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a164c693-0ae8-4005-b5ed-0cca796ad287 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:27.709292 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a164c693-0ae8-4005-b5ed-0cca796ad287 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:27.709708 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a164c693-0ae8-4005-b5ed-0cca796ad287 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:27.747342 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-c9b7941e-8985-4e3c-897d-2b7937503006 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:27.747944 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-c9b7941e-8985-4e3c-897d-2b7937503006 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:27.754644 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c9b7941e-8985-4e3c-897d-2b7937503006 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:27.755176 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c9b7941e-8985-4e3c-897d-2b7937503006 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:27.755604 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c9b7941e-8985-4e3c-897d-2b7937503006 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:27.756338 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c9b7941e-8985-4e3c-897d-2b7937503006 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:27.756784 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c9b7941e-8985-4e3c-897d-2b7937503006 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:27.757216 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c9b7941e-8985-4e3c-897d-2b7937503006 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:27.843394 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-a164c693-0ae8-4005-b5ed-0cca796ad287 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:27.853840 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-a164c693-0ae8-4005-b5ed-0cca796ad287 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51" status: 200 len: 1679 microversion: 2.1 time: 0.157917 Aug 06 14:36:27.867159 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 404/760] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:36:27 2022] GET /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:36:27.867159 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-caa4c00e-c3ad-4f85-a23f-e8d9cae46cd0 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:27.867159 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-caa4c00e-c3ad-4f85-a23f-e8d9cae46cd0 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 8805d1fa-6d65-45c7-ae75-17e46feccccb] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:27.867159 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-caa4c00e-c3ad-4f85-a23f-e8d9cae46cd0 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:27.868433 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-caa4c00e-c3ad-4f85-a23f-e8d9cae46cd0 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:27.868433 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-caa4c00e-c3ad-4f85-a23f-e8d9cae46cd0 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:27.868433 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-caa4c00e-c3ad-4f85-a23f-e8d9cae46cd0 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:27.868433 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-caa4c00e-c3ad-4f85-a23f-e8d9cae46cd0 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:27.868884 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-caa4c00e-c3ad-4f85-a23f-e8d9cae46cd0 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:27.919340 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-c9b7941e-8985-4e3c-897d-2b7937503006 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:27.927311 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-c9b7941e-8985-4e3c-897d-2b7937503006 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1676 microversion: 2.1 time: 0.184084 Aug 06 14:36:27.927854 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 357/761] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:36:27 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1676 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:36:28.014945 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-caa4c00e-c3ad-4f85-a23f-e8d9cae46cd0 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:28.017220 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:36:28.030657 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-caa4c00e-c3ad-4f85-a23f-e8d9cae46cd0 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb" status: 200 len: 1722 microversion: 2.1 time: 0.175187 Aug 06 14:36:28.031282 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 405/762] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:36:27 2022] GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:36:28.884336 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-34d7c627-3634-446c-8b43-10b3c0d0446f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:28.884993 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-34d7c627-3634-446c-8b43-10b3c0d0446f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 5a1c9667-a38f-471a-a735-b5dff6828a51] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:28.892140 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-34d7c627-3634-446c-8b43-10b3c0d0446f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:28.892554 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-34d7c627-3634-446c-8b43-10b3c0d0446f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:28.892979 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-34d7c627-3634-446c-8b43-10b3c0d0446f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:28.893662 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-34d7c627-3634-446c-8b43-10b3c0d0446f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:28.894107 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-34d7c627-3634-446c-8b43-10b3c0d0446f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:28.894524 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-34d7c627-3634-446c-8b43-10b3c0d0446f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:28.950109 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-75eeb768-5b55-4359-b396-d44aea3ce808 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:28.950731 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-75eeb768-5b55-4359-b396-d44aea3ce808 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:28.958623 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-75eeb768-5b55-4359-b396-d44aea3ce808 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:28.959133 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-75eeb768-5b55-4359-b396-d44aea3ce808 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:28.959563 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-75eeb768-5b55-4359-b396-d44aea3ce808 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:28.960248 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-75eeb768-5b55-4359-b396-d44aea3ce808 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:28.960992 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-75eeb768-5b55-4359-b396-d44aea3ce808 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:28.961420 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-75eeb768-5b55-4359-b396-d44aea3ce808 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:29.026978 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-34d7c627-3634-446c-8b43-10b3c0d0446f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:29.034249 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-34d7c627-3634-446c-8b43-10b3c0d0446f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51" status: 200 len: 1679 microversion: 2.1 time: 0.153754 Aug 06 14:36:29.034813 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 358/763] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:36:28 2022] GET /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:36:29.053304 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-fdf0f7ff-63d4-4f3c-9c48-9f3524fc5cb4 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:29.053908 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-fdf0f7ff-63d4-4f3c-9c48-9f3524fc5cb4 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 8805d1fa-6d65-45c7-ae75-17e46feccccb] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:29.060687 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-fdf0f7ff-63d4-4f3c-9c48-9f3524fc5cb4 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:29.061091 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-fdf0f7ff-63d4-4f3c-9c48-9f3524fc5cb4 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:29.061526 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-fdf0f7ff-63d4-4f3c-9c48-9f3524fc5cb4 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:29.062225 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-fdf0f7ff-63d4-4f3c-9c48-9f3524fc5cb4 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:29.062679 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-fdf0f7ff-63d4-4f3c-9c48-9f3524fc5cb4 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:29.063130 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-fdf0f7ff-63d4-4f3c-9c48-9f3524fc5cb4 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:29.140302 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-75eeb768-5b55-4359-b396-d44aea3ce808 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:29.148170 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-75eeb768-5b55-4359-b396-d44aea3ce808 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1653 microversion: 2.1 time: 0.202728 Aug 06 14:36:29.149028 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 406/764] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:36:28 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1653 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:36:29.168542 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-08b4476a-81e6-404f-ba26-d9db079c6189 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:36:29.174486 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-08b4476a-81e6-404f-ba26-d9db079c6189 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:29.174994 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-08b4476a-81e6-404f-ba26-d9db079c6189 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:29.175846 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-08b4476a-81e6-404f-ba26-d9db079c6189 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:29.199702 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-08b4476a-81e6-404f-ba26-d9db079c6189 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Going to try to start instance {{(pid=117837) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 06 14:36:29.207975 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-fdf0f7ff-63d4-4f3c-9c48-9f3524fc5cb4 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:29.215463 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-fdf0f7ff-63d4-4f3c-9c48-9f3524fc5cb4 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb" status: 200 len: 1728 microversion: 2.1 time: 0.165880 Aug 06 14:36:29.216263 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 359/765] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:36:29 2022] GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb => generated 1728 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:36:29.237441 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-0e751fb9-39b3-438f-b40a-9ed4e26d64ed tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:29.237693 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-0e751fb9-39b3-438f-b40a-9ed4e26d64ed tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 8805d1fa-6d65-45c7-ae75-17e46feccccb] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:29.244322 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0e751fb9-39b3-438f-b40a-9ed4e26d64ed tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:29.244805 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0e751fb9-39b3-438f-b40a-9ed4e26d64ed tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:29.245231 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0e751fb9-39b3-438f-b40a-9ed4e26d64ed tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:29.247536 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0e751fb9-39b3-438f-b40a-9ed4e26d64ed tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:29.247891 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-08b4476a-81e6-404f-ba26-d9db079c6189 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "POST /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac/action" status: 202 len: 0 microversion: 2.1 time: 0.082983 Aug 06 14:36:29.248018 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0e751fb9-39b3-438f-b40a-9ed4e26d64ed tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:29.248728 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 407/766] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Aug 6 14:36:29 2022] POST /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 14:36:29.248849 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0e751fb9-39b3-438f-b40a-9ed4e26d64ed tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:29.256775 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-fb3ec57d-6abb-4034-ad4a-8ca8a7a9abfb tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:29.257475 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-fb3ec57d-6abb-4034-ad4a-8ca8a7a9abfb tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:29.264305 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-fb3ec57d-6abb-4034-ad4a-8ca8a7a9abfb tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:29.264801 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-fb3ec57d-6abb-4034-ad4a-8ca8a7a9abfb tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:29.265236 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-fb3ec57d-6abb-4034-ad4a-8ca8a7a9abfb tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:29.265938 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-fb3ec57d-6abb-4034-ad4a-8ca8a7a9abfb tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:29.266391 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-fb3ec57d-6abb-4034-ad4a-8ca8a7a9abfb tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:29.266835 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-fb3ec57d-6abb-4034-ad4a-8ca8a7a9abfb tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:29.349047 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-0e751fb9-39b3-438f-b40a-9ed4e26d64ed tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.116691 Aug 06 14:36:29.349637 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 360/767] 10.222.0.17 () {58 vars in 1275 bytes} [Sat Aug 6 14:36:29 2022] GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb/os-interface => generated 284 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 14:36:29.574668 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-fb3ec57d-6abb-4034-ad4a-8ca8a7a9abfb tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:29.585299 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-fb3ec57d-6abb-4034-ad4a-8ca8a7a9abfb tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1662 microversion: 2.1 time: 0.332419 Aug 06 14:36:29.585883 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 408/768] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:36:29 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1662 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:36:30.055984 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-7e165ea3-564c-42ff-a573-e19459e3a1b8 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:30.056704 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-7e165ea3-564c-42ff-a573-e19459e3a1b8 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 5a1c9667-a38f-471a-a735-b5dff6828a51] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:30.063769 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7e165ea3-564c-42ff-a573-e19459e3a1b8 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:30.064410 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7e165ea3-564c-42ff-a573-e19459e3a1b8 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:30.064943 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7e165ea3-564c-42ff-a573-e19459e3a1b8 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:30.065778 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7e165ea3-564c-42ff-a573-e19459e3a1b8 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:30.066345 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7e165ea3-564c-42ff-a573-e19459e3a1b8 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:30.067462 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7e165ea3-564c-42ff-a573-e19459e3a1b8 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:30.170495 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-7e165ea3-564c-42ff-a573-e19459e3a1b8 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:30.182393 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-7e165ea3-564c-42ff-a573-e19459e3a1b8 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51" status: 200 len: 1612 microversion: 2.1 time: 0.130628 Aug 06 14:36:30.196744 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 361/769] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:36:30 2022] GET /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51 => generated 1612 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:36:30.418408 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [req-aaba29b5-33db-4a51-8db5-cc1b9770695b req-3a60b13a-7772-4ca1-ac94-afc6c62df284 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a1c9667-a38f-471a-a735-b5dff6828a51", "name": "network-vif-deleted", "tag": "68b8be56-ac5e-4c38-886e-400dc8b14354"}]} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:36:30.438193 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-aaba29b5-33db-4a51-8db5-cc1b9770695b req-3a60b13a-7772-4ca1-ac94-afc6c62df284 service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:30.440472 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-aaba29b5-33db-4a51-8db5-cc1b9770695b req-3a60b13a-7772-4ca1-ac94-afc6c62df284 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:30.441224 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-aaba29b5-33db-4a51-8db5-cc1b9770695b req-3a60b13a-7772-4ca1-ac94-afc6c62df284 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:30.461229 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.compute.server_external_events [req-aaba29b5-33db-4a51-8db5-cc1b9770695b req-3a60b13a-7772-4ca1-ac94-afc6c62df284 service nova] Creating event network-vif-deleted:68b8be56-ac5e-4c38-886e-400dc8b14354 for instance 5a1c9667-a38f-471a-a735-b5dff6828a51 on hv-cinder-85199 Aug 06 14:36:30.466465 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [req-aaba29b5-33db-4a51-8db5-cc1b9770695b req-3a60b13a-7772-4ca1-ac94-afc6c62df284 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055024 Aug 06 14:36:30.468322 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 409/770] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:36:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:36:30.606446 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-95a0f9a8-9bff-464f-a8a4-dc4cb9e4b5e1 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:30.606988 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-95a0f9a8-9bff-464f-a8a4-dc4cb9e4b5e1 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:30.613059 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-95a0f9a8-9bff-464f-a8a4-dc4cb9e4b5e1 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:30.613547 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-95a0f9a8-9bff-464f-a8a4-dc4cb9e4b5e1 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:30.613976 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-95a0f9a8-9bff-464f-a8a4-dc4cb9e4b5e1 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:30.614676 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-95a0f9a8-9bff-464f-a8a4-dc4cb9e4b5e1 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:30.615150 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-95a0f9a8-9bff-464f-a8a4-dc4cb9e4b5e1 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:30.615897 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-95a0f9a8-9bff-464f-a8a4-dc4cb9e4b5e1 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:30.926225 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-95a0f9a8-9bff-464f-a8a4-dc4cb9e4b5e1 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:30.940398 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-95a0f9a8-9bff-464f-a8a4-dc4cb9e4b5e1 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1662 microversion: 2.1 time: 0.338051 Aug 06 14:36:30.940999 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 362/771] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:36:30 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1662 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:36:31.134184 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [req-d82e23da-2d97-4bad-917e-90f5de8066d1 req-ba619adf-d69e-4429-adab-3f4b8aea4846 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8805d1fa-6d65-45c7-ae75-17e46feccccb", "tag": "6b7de55b-a834-4f94-92da-b46aaa6033a5"}]} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:36:31.177047 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-d82e23da-2d97-4bad-917e-90f5de8066d1 req-ba619adf-d69e-4429-adab-3f4b8aea4846 service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:31.177814 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-d82e23da-2d97-4bad-917e-90f5de8066d1 req-ba619adf-d69e-4429-adab-3f4b8aea4846 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:31.178262 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-d82e23da-2d97-4bad-917e-90f5de8066d1 req-ba619adf-d69e-4429-adab-3f4b8aea4846 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:31.205110 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.compute.server_external_events [req-d82e23da-2d97-4bad-917e-90f5de8066d1 req-ba619adf-d69e-4429-adab-3f4b8aea4846 service nova] Creating event network-changed:6b7de55b-a834-4f94-92da-b46aaa6033a5 for instance 8805d1fa-6d65-45c7-ae75-17e46feccccb on hv-cinder-85199 Aug 06 14:36:31.205511 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-56a4e575-ac1b-4c35-9d10-269095687d88 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:31.206236 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-56a4e575-ac1b-4c35-9d10-269095687d88 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 5a1c9667-a38f-471a-a735-b5dff6828a51] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:31.213334 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-56a4e575-ac1b-4c35-9d10-269095687d88 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:31.214370 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-56a4e575-ac1b-4c35-9d10-269095687d88 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:31.215209 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-56a4e575-ac1b-4c35-9d10-269095687d88 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:31.215327 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [req-d82e23da-2d97-4bad-917e-90f5de8066d1 req-ba619adf-d69e-4429-adab-3f4b8aea4846 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.168134 Aug 06 14:36:31.216271 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 410/772] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:36:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:36:31.220354 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-56a4e575-ac1b-4c35-9d10-269095687d88 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:31.221261 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-56a4e575-ac1b-4c35-9d10-269095687d88 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:31.221985 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-56a4e575-ac1b-4c35-9d10-269095687d88 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:31.249129 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:36:31.263028 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-56a4e575-ac1b-4c35-9d10-269095687d88 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:31.263871 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-56a4e575-ac1b-4c35-9d10-269095687d88 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:31.265204 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-56a4e575-ac1b-4c35-9d10-269095687d88 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:31.266004 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.objects.instance [None req-56a4e575-ac1b-4c35-9d10-269095687d88 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lazy-loading 'fault' on Instance uuid 5a1c9667-a38f-471a-a735-b5dff6828a51 {{(pid=117838) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 14:36:31.321174 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-56a4e575-ac1b-4c35-9d10-269095687d88 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:31.332369 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-56a4e575-ac1b-4c35-9d10-269095687d88 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51" status: 200 len: 1331 microversion: 2.1 time: 0.131374 Aug 06 14:36:31.333524 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 363/773] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:36:31 2022] GET /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51 => generated 1331 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:36:31.962041 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-646527ea-fedf-459a-bd4e-2be27da09504 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:31.962861 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-646527ea-fedf-459a-bd4e-2be27da09504 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:31.972184 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-646527ea-fedf-459a-bd4e-2be27da09504 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:31.972689 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-646527ea-fedf-459a-bd4e-2be27da09504 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:31.973134 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-646527ea-fedf-459a-bd4e-2be27da09504 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:31.973918 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-646527ea-fedf-459a-bd4e-2be27da09504 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:31.974439 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-646527ea-fedf-459a-bd4e-2be27da09504 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:31.974895 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-646527ea-fedf-459a-bd4e-2be27da09504 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:32.147114 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-646527ea-fedf-459a-bd4e-2be27da09504 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:32.158931 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-646527ea-fedf-459a-bd4e-2be27da09504 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1666 microversion: 2.1 time: 0.200884 Aug 06 14:36:32.171038 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 411/774] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:36:31 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1666 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:36:32.353539 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-a906bcbb-0753-4cd4-ba38-de23748c236b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:32.354280 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-a906bcbb-0753-4cd4-ba38-de23748c236b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 5a1c9667-a38f-471a-a735-b5dff6828a51] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:32.365476 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a906bcbb-0753-4cd4-ba38-de23748c236b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:32.365970 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a906bcbb-0753-4cd4-ba38-de23748c236b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:32.366404 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a906bcbb-0753-4cd4-ba38-de23748c236b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:32.367128 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a906bcbb-0753-4cd4-ba38-de23748c236b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:32.367576 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a906bcbb-0753-4cd4-ba38-de23748c236b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:32.368204 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a906bcbb-0753-4cd4-ba38-de23748c236b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:32.382150 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.wsgi [None req-a906bcbb-0753-4cd4-ba38-de23748c236b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] HTTP exception thrown: Instance 5a1c9667-a38f-471a-a735-b5dff6828a51 could not be found. Aug 06 14:36:32.383819 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-a906bcbb-0753-4cd4-ba38-de23748c236b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Request method failure captured: Aug 06 14:36:32.383819 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: request: GET /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51 HTTP/1.1 Aug 06 14:36:32.383819 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Accept: application/json Aug 06 14:36:32.383819 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Accept-Encoding: identity Aug 06 14:36:32.383819 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Connection: close Aug 06 14:36:32.383819 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Content-Length: 0 Aug 06 14:36:32.383819 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Content-Type: application/json Aug 06 14:36:32.383819 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Host: 10.222.0.17 Aug 06 14:36:32.383819 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Openstack-System-Scope: None Aug 06 14:36:32.383819 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: User-Agent: python-urllib3/1.26.11 Aug 06 14:36:32.383819 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Auth-Token: gAAAAABi7nrw1j_Ge2Ur2tEojXwBmjEDUihl-N8v1g20aSIVDaeL_OTgCZQS1IFihI0AmtEC1h-SgLRiudvycNkR7KjoTpqo7M5425d9Dy_4zXKbCfizwmIbraJL9PsVC3rQgInSWh6L4pF_pLJlUkvGCOVZ6ElDrY4gMQsJ7uwAoVwYy3EWJq0 Aug 06 14:36:32.383819 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Domain-Id: None Aug 06 14:36:32.383819 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Domain-Name: None Aug 06 14:36:32.383819 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Identity-Status: Confirmed Aug 06 14:36:32.383819 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Is-Admin-Project: True Aug 06 14:36:32.383819 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Domain-Id: default Aug 06 14:36:32.383819 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Domain-Name: Default Aug 06 14:36:32.383819 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Id: 96a7bb12d3ed4d1db2a58a03472483c2 Aug 06 14:36:32.383819 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Name: tempest-AttachVolumeNegativeTest-927490997 Aug 06 14:36:32.383819 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Role: member,reader Aug 06 14:36:32.383819 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Roles: member,reader Aug 06 14:36:32.385456 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/96a7bb12d3ed4d1db2a58a03472483c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/96a7bb12d3ed4d1db2a58a03472483c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_96a7bb12d3ed4d1db2a58a03472483c2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/96a7bb12d3ed4d1db2a58a03472483c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 06 14:36:32.385456 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Tenant: tempest-AttachVolumeNegativeTest-927490997 Aug 06 14:36:32.385456 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Tenant-Id: 96a7bb12d3ed4d1db2a58a03472483c2 Aug 06 14:36:32.385456 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-927490997 Aug 06 14:36:32.385456 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User: tempest-AttachVolumeNegativeTest-927490997-project Aug 06 14:36:32.385456 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Domain-Id: default Aug 06 14:36:32.385456 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Domain-Name: Default Aug 06 14:36:32.385456 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Id: 5378c85cd31c42dfbc39ce738a8b6dde Aug 06 14:36:32.385456 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Name: tempest-AttachVolumeNegativeTest-927490997-project Aug 06 14:36:32.385456 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: method: > Aug 06 14:36:32.385456 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: exception: Instance 5a1c9667-a38f-471a-a735-b5dff6828a51 could not be found. Aug 06 14:36:32.385456 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: action_args: {'id': '5a1c9667-a38f-471a-a735-b5dff6828a51'} Aug 06 14:36:32.387959 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 14:36:32.387959 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:36:32.387959 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 14:36:32.387959 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 14:36:32.387959 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 14:36:32.387959 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 14:36:32.387959 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 14:36:32.387959 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 14:36:32.387959 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 14:36:32.387959 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 14:36:32.387959 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a1c9667-a38f-471a-a735-b5dff6828a51 could not be found. Aug 06 14:36:32.387959 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:36:32.387959 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:36:32.387959 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:36:32.387959 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:36:32.387959 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:36:32.387959 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:36:32.387959 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 14:36:32.387959 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 14:36:32.387959 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 14:36:32.389451 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 14:36:32.389451 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 14:36:32.389451 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 14:36:32.389451 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 14:36:32.389451 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 14:36:32.389451 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 14:36:32.389451 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 14:36:32.389451 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a1c9667-a38f-471a-a735-b5dff6828a51 could not be found. Aug 06 14:36:32.389451 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:36:32.389451 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:36:32.389451 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:36:32.389451 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:36:32.389451 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:36:32.389451 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:36:32.389451 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 14:36:32.389451 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 14:36:32.389451 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a1c9667-a38f-471a-a735-b5dff6828a51 could not be found. Aug 06 14:36:32.389451 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:36:32.390734 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-a906bcbb-0753-4cd4-ba38-de23748c236b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Returning 404 to user: Instance 5a1c9667-a38f-471a-a735-b5dff6828a51 could not be found. {{(pid=117838) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 14:36:32.390734 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-a906bcbb-0753-4cd4-ba38-de23748c236b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51" status: 404 len: 111 microversion: 2.1 time: 0.035549 Aug 06 14:36:32.390734 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 364/775] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:36:32 2022] GET /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 14:36:32.395535 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-9f933123-0490-4438-8649-676ff7486cd0 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '.version_select at 0x7fbab0ca9280>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:32.420594 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-9f933123-0490-4438-8649-676ff7486cd0 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1672036177" status: 202 len: 0 microversion: 2.1 time: 0.029718 Aug 06 14:36:32.421197 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 412/776] 10.222.0.17 () {58 vars in 1221 bytes} [Sat Aug 6 14:36:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1672036177 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 14:36:33.087408 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-763c4419-d3e2-42e3-a891-c1421cf6562c tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:33.087898 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-763c4419-d3e2-42e3-a891-c1421cf6562c tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6e717f01-c854-444e-9872-51e2c1c78987] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:33.093802 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-763c4419-d3e2-42e3-a891-c1421cf6562c tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:33.094269 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-763c4419-d3e2-42e3-a891-c1421cf6562c tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:33.094701 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-763c4419-d3e2-42e3-a891-c1421cf6562c tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:33.095419 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-763c4419-d3e2-42e3-a891-c1421cf6562c tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:33.095876 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-763c4419-d3e2-42e3-a891-c1421cf6562c tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:33.096298 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-763c4419-d3e2-42e3-a891-c1421cf6562c tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:33.174458 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.objects.instance [None req-763c4419-d3e2-42e3-a891-c1421cf6562c tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lazy-loading 'services' on Instance uuid 6e717f01-c854-444e-9872-51e2c1c78987 {{(pid=117838) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 14:36:33.231195 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [req-d0af0ef3-feac-40b0-b893-ea3530b67b82 req-efd8c1c0-0c81-4e25-b2cc-fa112aa0073d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8805d1fa-6d65-45c7-ae75-17e46feccccb", "tag": "6b7de55b-a834-4f94-92da-b46aaa6033a5"}]} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:36:33.242197 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-d0af0ef3-feac-40b0-b893-ea3530b67b82 req-efd8c1c0-0c81-4e25-b2cc-fa112aa0073d service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:33.242679 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-d0af0ef3-feac-40b0-b893-ea3530b67b82 req-efd8c1c0-0c81-4e25-b2cc-fa112aa0073d service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:33.243141 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-d0af0ef3-feac-40b0-b893-ea3530b67b82 req-efd8c1c0-0c81-4e25-b2cc-fa112aa0073d service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:33.247893 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-763c4419-d3e2-42e3-a891-c1421cf6562c tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "DELETE /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987/os-volume_attachments/9e8a5fc3-29f8-4032-ac5f-a0c16cb37485" status: 202 len: 0 microversion: 2.1 time: 0.164143 Aug 06 14:36:33.248517 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 365/777] 10.222.0.17 () {58 vars in 1416 bytes} [Sat Aug 6 14:36:33 2022] DELETE /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987/os-volume_attachments/9e8a5fc3-29f8-4032-ac5f-a0c16cb37485 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 14:36:33.254452 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.compute.server_external_events [req-d0af0ef3-feac-40b0-b893-ea3530b67b82 req-efd8c1c0-0c81-4e25-b2cc-fa112aa0073d service nova] Creating event network-changed:6b7de55b-a834-4f94-92da-b46aaa6033a5 for instance 8805d1fa-6d65-45c7-ae75-17e46feccccb on hv-cinder-85199 Aug 06 14:36:33.257177 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-4defbbb1-2039-40ed-a4ba-36ecc2fffec3 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:33.259212 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [req-d0af0ef3-feac-40b0-b893-ea3530b67b82 req-efd8c1c0-0c81-4e25-b2cc-fa112aa0073d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032534 Aug 06 14:36:33.259592 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-4defbbb1-2039-40ed-a4ba-36ecc2fffec3 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6e717f01-c854-444e-9872-51e2c1c78987] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:33.260134 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 413/778] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:36:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 14:36:33.266086 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4defbbb1-2039-40ed-a4ba-36ecc2fffec3 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:33.266829 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4defbbb1-2039-40ed-a4ba-36ecc2fffec3 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:33.267118 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4defbbb1-2039-40ed-a4ba-36ecc2fffec3 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:33.267618 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4defbbb1-2039-40ed-a4ba-36ecc2fffec3 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:33.268095 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4defbbb1-2039-40ed-a4ba-36ecc2fffec3 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:33.268658 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4defbbb1-2039-40ed-a4ba-36ecc2fffec3 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:33.298823 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-4defbbb1-2039-40ed-a4ba-36ecc2fffec3 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045825 Aug 06 14:36:33.299402 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 366/779] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Aug 6 14:36:33 2022] GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 14:36:34.315078 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-262b62df-de6e-426f-a61c-9aff9183951d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:34.317306 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-262b62df-de6e-426f-a61c-9aff9183951d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6e717f01-c854-444e-9872-51e2c1c78987] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:34.323563 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-262b62df-de6e-426f-a61c-9aff9183951d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:34.324641 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-262b62df-de6e-426f-a61c-9aff9183951d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:34.325074 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-262b62df-de6e-426f-a61c-9aff9183951d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:34.325757 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-262b62df-de6e-426f-a61c-9aff9183951d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:34.326205 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-262b62df-de6e-426f-a61c-9aff9183951d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:34.326629 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-262b62df-de6e-426f-a61c-9aff9183951d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:34.356388 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-262b62df-de6e-426f-a61c-9aff9183951d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048100 Aug 06 14:36:34.356929 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 414/780] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Aug 6 14:36:34 2022] GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:36:35.367644 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-080aaaf0-85d5-4b8f-84c7-80aa2fe3c771 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:35.369775 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-080aaaf0-85d5-4b8f-84c7-80aa2fe3c771 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6e717f01-c854-444e-9872-51e2c1c78987] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:35.376199 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-080aaaf0-85d5-4b8f-84c7-80aa2fe3c771 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:35.376666 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-080aaaf0-85d5-4b8f-84c7-80aa2fe3c771 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:35.377093 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-080aaaf0-85d5-4b8f-84c7-80aa2fe3c771 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:35.377764 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-080aaaf0-85d5-4b8f-84c7-80aa2fe3c771 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:35.378210 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-080aaaf0-85d5-4b8f-84c7-80aa2fe3c771 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:35.378631 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-080aaaf0-85d5-4b8f-84c7-80aa2fe3c771 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:35.408463 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-080aaaf0-85d5-4b8f-84c7-80aa2fe3c771 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044745 Aug 06 14:36:35.409003 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 367/781] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Aug 6 14:36:35 2022] GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 14:36:35.469950 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-2f292e5f-7cbe-4a31-891e-80cec0c8241c tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:35.470462 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-2f292e5f-7cbe-4a31-891e-80cec0c8241c tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6e717f01-c854-444e-9872-51e2c1c78987] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:35.476816 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2f292e5f-7cbe-4a31-891e-80cec0c8241c tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:35.477292 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2f292e5f-7cbe-4a31-891e-80cec0c8241c tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:35.477719 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2f292e5f-7cbe-4a31-891e-80cec0c8241c tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:35.478395 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2f292e5f-7cbe-4a31-891e-80cec0c8241c tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:35.478839 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2f292e5f-7cbe-4a31-891e-80cec0c8241c tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:35.479306 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2f292e5f-7cbe-4a31-891e-80cec0c8241c tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:35.503013 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-2f292e5f-7cbe-4a31-891e-80cec0c8241c tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6e717f01-c854-444e-9872-51e2c1c78987] Going to try to terminate instance {{(pid=117837) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 14:36:35.575554 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-2f292e5f-7cbe-4a31-891e-80cec0c8241c tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "DELETE /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987" status: 204 len: 0 microversion: 2.1 time: 0.109131 Aug 06 14:36:35.576251 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 415/782] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Aug 6 14:36:35 2022] DELETE /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 06 14:36:35.584599 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-be985309-53d5-4c07-b653-e07fdc57db1d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:35.585198 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-be985309-53d5-4c07-b653-e07fdc57db1d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6e717f01-c854-444e-9872-51e2c1c78987] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:35.591775 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-be985309-53d5-4c07-b653-e07fdc57db1d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:35.592247 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-be985309-53d5-4c07-b653-e07fdc57db1d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:35.592669 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-be985309-53d5-4c07-b653-e07fdc57db1d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:35.593358 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-be985309-53d5-4c07-b653-e07fdc57db1d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:35.593787 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-be985309-53d5-4c07-b653-e07fdc57db1d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:35.594202 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-be985309-53d5-4c07-b653-e07fdc57db1d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:35.727072 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-be985309-53d5-4c07-b653-e07fdc57db1d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:35.734552 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-be985309-53d5-4c07-b653-e07fdc57db1d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987" status: 200 len: 1682 microversion: 2.1 time: 0.153800 Aug 06 14:36:35.735204 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 368/783] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:36:35 2022] GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:36:36.756389 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-5906f18b-cccd-4a64-a322-8d000956ee9e tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:36.757086 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-5906f18b-cccd-4a64-a322-8d000956ee9e tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6e717f01-c854-444e-9872-51e2c1c78987] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:36.763922 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-5906f18b-cccd-4a64-a322-8d000956ee9e tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:36.764423 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-5906f18b-cccd-4a64-a322-8d000956ee9e tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:36.764857 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-5906f18b-cccd-4a64-a322-8d000956ee9e tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:36.765541 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-5906f18b-cccd-4a64-a322-8d000956ee9e tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:36.765993 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-5906f18b-cccd-4a64-a322-8d000956ee9e tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:36.766415 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-5906f18b-cccd-4a64-a322-8d000956ee9e tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:36.896323 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-5906f18b-cccd-4a64-a322-8d000956ee9e tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:36.904375 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-5906f18b-cccd-4a64-a322-8d000956ee9e tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987" status: 200 len: 1682 microversion: 2.1 time: 0.152166 Aug 06 14:36:36.904937 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 416/784] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:36:36 2022] GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:36:37.673755 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [req-1401742d-025f-4b40-87a7-12e9eaf66289 req-fa8ade61-3bf9-4ce2-ab91-fed723d46055 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e717f01-c854-444e-9872-51e2c1c78987", "name": "network-vif-deleted", "tag": "9540450a-1a6b-4c4e-972a-4fb6ca932a45"}]} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:36:37.685174 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-1401742d-025f-4b40-87a7-12e9eaf66289 req-fa8ade61-3bf9-4ce2-ab91-fed723d46055 service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:37.685653 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-1401742d-025f-4b40-87a7-12e9eaf66289 req-fa8ade61-3bf9-4ce2-ab91-fed723d46055 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:37.686081 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-1401742d-025f-4b40-87a7-12e9eaf66289 req-fa8ade61-3bf9-4ce2-ab91-fed723d46055 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:37.699484 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.compute.server_external_events [req-1401742d-025f-4b40-87a7-12e9eaf66289 req-fa8ade61-3bf9-4ce2-ab91-fed723d46055 service nova] Creating event network-vif-deleted:9540450a-1a6b-4c4e-972a-4fb6ca932a45 for instance 6e717f01-c854-444e-9872-51e2c1c78987 on hv-cinder-85199 Aug 06 14:36:37.705232 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [req-1401742d-025f-4b40-87a7-12e9eaf66289 req-fa8ade61-3bf9-4ce2-ab91-fed723d46055 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035568 Aug 06 14:36:37.705845 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 369/785] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:36:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:36:37.715946 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-4e750e16-f8ab-435a-8ef5-91bea7e1154f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:37.716470 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-4e750e16-f8ab-435a-8ef5-91bea7e1154f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:37.722581 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-4e750e16-f8ab-435a-8ef5-91bea7e1154f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:37.723106 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-4e750e16-f8ab-435a-8ef5-91bea7e1154f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:37.723533 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-4e750e16-f8ab-435a-8ef5-91bea7e1154f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:37.724724 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-4e750e16-f8ab-435a-8ef5-91bea7e1154f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:37.725021 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-4e750e16-f8ab-435a-8ef5-91bea7e1154f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:37.725438 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-4e750e16-f8ab-435a-8ef5-91bea7e1154f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:37.758203 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-4e750e16-f8ab-435a-8ef5-91bea7e1154f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8/os-volume_attachments/0af1c2dd-cef8-4259-95fb-890ab02c6bc1" status: 200 len: 194 microversion: 2.20 time: 0.046210 Aug 06 14:36:37.767687 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 417/786] 10.222.0.17 () {60 vars in 1454 bytes} [Sat Aug 6 14:36:37 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8/os-volume_attachments/0af1c2dd-cef8-4259-95fb-890ab02c6bc1 => generated 194 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 14:36:37.860779 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-429adae8-0a5e-4248-906a-67466e56cfbd tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:37.861348 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-429adae8-0a5e-4248-906a-67466e56cfbd tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:37.868941 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-429adae8-0a5e-4248-906a-67466e56cfbd tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:37.869660 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-429adae8-0a5e-4248-906a-67466e56cfbd tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:37.870269 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-429adae8-0a5e-4248-906a-67466e56cfbd tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:37.872145 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-429adae8-0a5e-4248-906a-67466e56cfbd tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:37.872873 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-429adae8-0a5e-4248-906a-67466e56cfbd tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:37.873540 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-429adae8-0a5e-4248-906a-67466e56cfbd tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:37.926193 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-66c2089a-de63-48ad-bbcb-d864a1e21a9e tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:37.926906 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-66c2089a-de63-48ad-bbcb-d864a1e21a9e tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6e717f01-c854-444e-9872-51e2c1c78987] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:37.939164 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-66c2089a-de63-48ad-bbcb-d864a1e21a9e tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:37.939885 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-66c2089a-de63-48ad-bbcb-d864a1e21a9e tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:37.940322 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-66c2089a-de63-48ad-bbcb-d864a1e21a9e tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:37.941036 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-66c2089a-de63-48ad-bbcb-d864a1e21a9e tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:37.941493 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-66c2089a-de63-48ad-bbcb-d864a1e21a9e tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:37.941910 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-66c2089a-de63-48ad-bbcb-d864a1e21a9e tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:37.978779 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-66c2089a-de63-48ad-bbcb-d864a1e21a9e tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:37.979510 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-66c2089a-de63-48ad-bbcb-d864a1e21a9e tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:37.980812 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-66c2089a-de63-48ad-bbcb-d864a1e21a9e tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:37.981618 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.objects.instance [None req-66c2089a-de63-48ad-bbcb-d864a1e21a9e tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lazy-loading 'fault' on Instance uuid 6e717f01-c854-444e-9872-51e2c1c78987 {{(pid=117837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 14:36:38.005103 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.objects.instance [None req-429adae8-0a5e-4248-906a-67466e56cfbd tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lazy-loading 'services' on Instance uuid 5cf29bae-83f8-43e3-9118-0fea5a019ff8 {{(pid=117838) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 14:36:38.023797 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-66c2089a-de63-48ad-bbcb-d864a1e21a9e tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:38.032796 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-66c2089a-de63-48ad-bbcb-d864a1e21a9e tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987" status: 200 len: 1331 microversion: 2.1 time: 0.110982 Aug 06 14:36:38.034905 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 418/787] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:36:37 2022] GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987 => generated 1331 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:36:38.086182 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-429adae8-0a5e-4248-906a-67466e56cfbd tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8/os-volume_attachments/0af1c2dd-cef8-4259-95fb-890ab02c6bc1" status: 202 len: 0 microversion: 2.20 time: 0.229544 Aug 06 14:36:38.086883 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 370/788] 10.222.0.17 () {60 vars in 1457 bytes} [Sat Aug 6 14:36:37 2022] DELETE /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8/os-volume_attachments/0af1c2dd-cef8-4259-95fb-890ab02c6bc1 => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 06 14:36:38.095957 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-6c77002b-35ee-4f83-907d-8ac0b0348cd6 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:38.098141 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-6c77002b-35ee-4f83-907d-8ac0b0348cd6 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:38.104309 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6c77002b-35ee-4f83-907d-8ac0b0348cd6 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:38.104790 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6c77002b-35ee-4f83-907d-8ac0b0348cd6 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:38.105824 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6c77002b-35ee-4f83-907d-8ac0b0348cd6 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:38.106533 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6c77002b-35ee-4f83-907d-8ac0b0348cd6 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:38.107023 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6c77002b-35ee-4f83-907d-8ac0b0348cd6 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:38.107446 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6c77002b-35ee-4f83-907d-8ac0b0348cd6 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:38.137095 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-6c77002b-35ee-4f83-907d-8ac0b0348cd6 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045042 Aug 06 14:36:38.137649 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 419/789] 10.222.0.17 () {60 vars in 1343 bytes} [Sat Aug 6 14:36:38 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 06 14:36:39.055348 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-8fa3edbf-a43e-4194-9354-cfa757ab57aa tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:39.056044 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-8fa3edbf-a43e-4194-9354-cfa757ab57aa tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6e717f01-c854-444e-9872-51e2c1c78987] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:39.062981 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8fa3edbf-a43e-4194-9354-cfa757ab57aa tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:39.063459 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8fa3edbf-a43e-4194-9354-cfa757ab57aa tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:39.063891 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8fa3edbf-a43e-4194-9354-cfa757ab57aa tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:39.064572 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8fa3edbf-a43e-4194-9354-cfa757ab57aa tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:39.065025 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8fa3edbf-a43e-4194-9354-cfa757ab57aa tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:39.065446 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8fa3edbf-a43e-4194-9354-cfa757ab57aa tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:39.079021 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.wsgi [None req-8fa3edbf-a43e-4194-9354-cfa757ab57aa tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] HTTP exception thrown: Instance 6e717f01-c854-444e-9872-51e2c1c78987 could not be found. Aug 06 14:36:39.080637 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-8fa3edbf-a43e-4194-9354-cfa757ab57aa tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Request method failure captured: Aug 06 14:36:39.080637 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: request: GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987 HTTP/1.1 Aug 06 14:36:39.080637 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Accept: application/json Aug 06 14:36:39.080637 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Accept-Encoding: identity Aug 06 14:36:39.080637 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Connection: close Aug 06 14:36:39.080637 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Content-Length: 0 Aug 06 14:36:39.080637 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Content-Type: application/json Aug 06 14:36:39.080637 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Host: 10.222.0.17 Aug 06 14:36:39.080637 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Openstack-System-Scope: None Aug 06 14:36:39.080637 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: User-Agent: python-urllib3/1.26.11 Aug 06 14:36:39.080637 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Auth-Token: gAAAAABi7nrw1j_Ge2Ur2tEojXwBmjEDUihl-N8v1g20aSIVDaeL_OTgCZQS1IFihI0AmtEC1h-SgLRiudvycNkR7KjoTpqo7M5425d9Dy_4zXKbCfizwmIbraJL9PsVC3rQgInSWh6L4pF_pLJlUkvGCOVZ6ElDrY4gMQsJ7uwAoVwYy3EWJq0 Aug 06 14:36:39.080637 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Domain-Id: None Aug 06 14:36:39.080637 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Domain-Name: None Aug 06 14:36:39.080637 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Identity-Status: Confirmed Aug 06 14:36:39.080637 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Is-Admin-Project: True Aug 06 14:36:39.080637 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Domain-Id: default Aug 06 14:36:39.080637 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Domain-Name: Default Aug 06 14:36:39.080637 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Id: 96a7bb12d3ed4d1db2a58a03472483c2 Aug 06 14:36:39.080637 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Name: tempest-AttachVolumeNegativeTest-927490997 Aug 06 14:36:39.080637 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Role: member,reader Aug 06 14:36:39.080637 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Roles: member,reader Aug 06 14:36:39.082257 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/96a7bb12d3ed4d1db2a58a03472483c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/96a7bb12d3ed4d1db2a58a03472483c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_96a7bb12d3ed4d1db2a58a03472483c2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/96a7bb12d3ed4d1db2a58a03472483c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 06 14:36:39.082257 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Tenant: tempest-AttachVolumeNegativeTest-927490997 Aug 06 14:36:39.082257 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Tenant-Id: 96a7bb12d3ed4d1db2a58a03472483c2 Aug 06 14:36:39.082257 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-927490997 Aug 06 14:36:39.082257 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User: tempest-AttachVolumeNegativeTest-927490997-project Aug 06 14:36:39.082257 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Domain-Id: default Aug 06 14:36:39.082257 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Domain-Name: Default Aug 06 14:36:39.082257 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Id: 5378c85cd31c42dfbc39ce738a8b6dde Aug 06 14:36:39.082257 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Name: tempest-AttachVolumeNegativeTest-927490997-project Aug 06 14:36:39.082257 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: method: > Aug 06 14:36:39.082257 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: exception: Instance 6e717f01-c854-444e-9872-51e2c1c78987 could not be found. Aug 06 14:36:39.082257 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: action_args: {'id': '6e717f01-c854-444e-9872-51e2c1c78987'} Aug 06 14:36:39.083139 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 14:36:39.083139 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:36:39.083139 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 14:36:39.083139 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 14:36:39.083139 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 14:36:39.083139 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 14:36:39.083139 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 14:36:39.083139 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 14:36:39.083139 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 14:36:39.083139 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 14:36:39.083139 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e717f01-c854-444e-9872-51e2c1c78987 could not be found. Aug 06 14:36:39.083139 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:36:39.083139 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:36:39.083139 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:36:39.083139 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:36:39.083139 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:36:39.083139 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:36:39.083139 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 14:36:39.083139 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 14:36:39.083139 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 14:36:39.084674 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 14:36:39.084674 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 14:36:39.084674 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 14:36:39.084674 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 14:36:39.084674 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 14:36:39.084674 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 14:36:39.084674 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 14:36:39.084674 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e717f01-c854-444e-9872-51e2c1c78987 could not be found. Aug 06 14:36:39.084674 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:36:39.084674 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:36:39.084674 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:36:39.084674 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:36:39.084674 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:36:39.084674 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:36:39.084674 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 14:36:39.084674 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 14:36:39.084674 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e717f01-c854-444e-9872-51e2c1c78987 could not be found. Aug 06 14:36:39.084674 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:36:39.085996 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-8fa3edbf-a43e-4194-9354-cfa757ab57aa tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Returning 404 to user: Instance 6e717f01-c854-444e-9872-51e2c1c78987 could not be found. {{(pid=117838) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 14:36:39.085996 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-8fa3edbf-a43e-4194-9354-cfa757ab57aa tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987" status: 404 len: 111 microversion: 2.1 time: 0.031542 Aug 06 14:36:39.085996 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 371/790] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:36:39 2022] GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 14:36:39.091243 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-5957c9c7-1a40-4d71-922f-e68082044a2a tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '.version_select at 0x7fbab0cf2e50>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:39.109047 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-5957c9c7-1a40-4d71-922f-e68082044a2a tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1989844630" status: 202 len: 0 microversion: 2.1 time: 0.021642 Aug 06 14:36:39.109630 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 420/791] 10.222.0.17 () {58 vars in 1221 bytes} [Sat Aug 6 14:36:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1989844630 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 14:36:39.149518 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-e3c26f60-42a3-4fce-801e-68a832558728 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:39.151848 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-e3c26f60-42a3-4fce-801e-68a832558728 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:39.157680 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e3c26f60-42a3-4fce-801e-68a832558728 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:39.158159 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e3c26f60-42a3-4fce-801e-68a832558728 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:39.158589 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e3c26f60-42a3-4fce-801e-68a832558728 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:39.159301 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e3c26f60-42a3-4fce-801e-68a832558728 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:39.159750 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e3c26f60-42a3-4fce-801e-68a832558728 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:39.160169 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e3c26f60-42a3-4fce-801e-68a832558728 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:39.190129 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-e3c26f60-42a3-4fce-801e-68a832558728 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044544 Aug 06 14:36:39.190680 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 372/792] 10.222.0.17 () {60 vars in 1343 bytes} [Sat Aug 6 14:36:39 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 14:36:39.747174 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-c5f3fd65-7285-4114-b536-d2ee44d5e8dc tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Action: 'create', calling method: .version_select at 0x7fbab0ca9940>, body: {"keypair": {"name": "tempest-keypair-1094861768", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFax5ISJjZpG4pJ6s6JbDfhSM+23okJSf8R1zs0O/HgHWSBkJriF70Z1sLn+RgEfxpkT6g4mzVrshFpAOCOb7vogLga2Xw0GctY9LNc9q99pKwoZlM60IrknPi0SxcpYLA=="}} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:36:39.762840 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.quota [None req-c5f3fd65-7285-4114-b536-d2ee44d5e8dc tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Getting quotas for project 96a7bb12d3ed4d1db2a58a03472483c2. Resources: {'key_pairs'} {{(pid=117837) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 14:36:39.766613 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.quota [None req-c5f3fd65-7285-4114-b536-d2ee44d5e8dc tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Getting quotas for user 5378c85cd31c42dfbc39ce738a8b6dde and project 96a7bb12d3ed4d1db2a58a03472483c2. Resources: {'key_pairs'} {{(pid=117837) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 14:36:39.787806 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-c5f3fd65-7285-4114-b536-d2ee44d5e8dc tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045265 Aug 06 14:36:39.788383 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 421/793] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Aug 6 14:36:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:36:40.202459 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-dec5735f-527d-4510-9dd1-60f5afd8c377 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:40.204618 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-dec5735f-527d-4510-9dd1-60f5afd8c377 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:40.212164 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-dec5735f-527d-4510-9dd1-60f5afd8c377 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:40.212657 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-dec5735f-527d-4510-9dd1-60f5afd8c377 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:40.213087 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-dec5735f-527d-4510-9dd1-60f5afd8c377 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:40.213790 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-dec5735f-527d-4510-9dd1-60f5afd8c377 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:40.214251 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-dec5735f-527d-4510-9dd1-60f5afd8c377 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:40.214669 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-dec5735f-527d-4510-9dd1-60f5afd8c377 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:40.245557 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-dec5735f-527d-4510-9dd1-60f5afd8c377 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047768 Aug 06 14:36:40.246125 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 373/794] 10.222.0.17 () {60 vars in 1343 bytes} [Sat Aug 6 14:36:40 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:36:40.310729 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-347fa25f-8025-4f49-aab4-1d5f4540add2 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:40.311301 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-347fa25f-8025-4f49-aab4-1d5f4540add2 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:40.317200 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-347fa25f-8025-4f49-aab4-1d5f4540add2 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:40.317742 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-347fa25f-8025-4f49-aab4-1d5f4540add2 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:40.318235 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-347fa25f-8025-4f49-aab4-1d5f4540add2 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:40.319017 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-347fa25f-8025-4f49-aab4-1d5f4540add2 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:40.319466 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-347fa25f-8025-4f49-aab4-1d5f4540add2 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:40.319880 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-347fa25f-8025-4f49-aab4-1d5f4540add2 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:40.347680 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-347fa25f-8025-4f49-aab4-1d5f4540add2 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Going to try to terminate instance {{(pid=117837) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 14:36:40.399578 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:36:40.427258 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-347fa25f-8025-4f49-aab4-1d5f4540add2 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 204 len: 0 microversion: 2.20 time: 0.121580 Aug 06 14:36:40.432697 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 422/795] 10.222.0.17 () {60 vars in 1280 bytes} [Sat Aug 6 14:36:40 2022] DELETE /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 06 14:36:40.437843 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-22dceadc-719e-4d2c-8926-61650047220b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:40.438662 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-22dceadc-719e-4d2c-8926-61650047220b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:40.444523 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-22dceadc-719e-4d2c-8926-61650047220b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:40.445001 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-22dceadc-719e-4d2c-8926-61650047220b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:40.445614 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-22dceadc-719e-4d2c-8926-61650047220b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:40.446486 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-22dceadc-719e-4d2c-8926-61650047220b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:40.446964 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-22dceadc-719e-4d2c-8926-61650047220b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:40.447392 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-22dceadc-719e-4d2c-8926-61650047220b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:40.578927 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-22dceadc-719e-4d2c-8926-61650047220b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:40.587674 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-22dceadc-719e-4d2c-8926-61650047220b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:40.589176 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-22dceadc-719e-4d2c-8926-61650047220b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:40.590479 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-22dceadc-719e-4d2c-8926-61650047220b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1725 microversion: 2.20 time: 0.156385 Aug 06 14:36:40.591129 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 374/796] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:36:40 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:36:41.023794 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-497bb425-d9e4-44bf-a1bd-9b359620df93 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1524115446", "imageRef": "13d7ee60-c9c3-43ee-9861-a9192a114a77", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9b050990-e64f-42d3-84c7-d36c3ef1c328"}], "security_groups": [{"name": "tempest-securitygroup--1511313237"}], "key_name": "tempest-keypair-1094861768", "user_data": "}} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:36:41.126475 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.network.neutron [None req-497bb425-d9e4-44bf-a1bd-9b359620df93 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] validate_networks() for [('9b050990-e64f-42d3-84c7-d36c3ef1c328', None, None, None, None, None)] {{(pid=117837) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 14:36:41.580793 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.virt.hardware [None req-497bb425-d9e4-44bf-a1bd-9b359620df93 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Flavor limits 0:0:0 {{(pid=117837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 14:36:41.581521 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.virt.hardware [None req-497bb425-d9e4-44bf-a1bd-9b359620df93 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Image limits 0:0:0 {{(pid=117837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 14:36:41.581694 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.virt.hardware [None req-497bb425-d9e4-44bf-a1bd-9b359620df93 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Flavor pref 0:0:0 {{(pid=117837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 14:36:41.582121 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.virt.hardware [None req-497bb425-d9e4-44bf-a1bd-9b359620df93 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Image pref 0:0:0 {{(pid=117837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 14:36:41.582553 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.virt.hardware [None req-497bb425-d9e4-44bf-a1bd-9b359620df93 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 14:36:41.591830 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-497bb425-d9e4-44bf-a1bd-9b359620df93 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:41.592309 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-497bb425-d9e4-44bf-a1bd-9b359620df93 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:41.592778 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-497bb425-d9e4-44bf-a1bd-9b359620df93 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:41.593502 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-497bb425-d9e4-44bf-a1bd-9b359620df93 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:41.593956 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-497bb425-d9e4-44bf-a1bd-9b359620df93 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:41.594375 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-497bb425-d9e4-44bf-a1bd-9b359620df93 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:41.606615 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=2,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:36:41.614044 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.quota [None req-497bb425-d9e4-44bf-a1bd-9b359620df93 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Getting quotas for project 96a7bb12d3ed4d1db2a58a03472483c2. Resources: {'cores', 'instances', 'ram'} {{(pid=117837) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 14:36:41.615101 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-3fe2f4e9-098f-4b5b-a251-b2522505f8ab tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:41.615714 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-3fe2f4e9-098f-4b5b-a251-b2522505f8ab tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:41.617948 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:36:41.619164 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.quota [None req-497bb425-d9e4-44bf-a1bd-9b359620df93 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Getting quotas for user 5378c85cd31c42dfbc39ce738a8b6dde and project 96a7bb12d3ed4d1db2a58a03472483c2. Resources: {'cores', 'instances', 'ram'} {{(pid=117837) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 14:36:41.623729 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3fe2f4e9-098f-4b5b-a251-b2522505f8ab tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:41.624370 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3fe2f4e9-098f-4b5b-a251-b2522505f8ab tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:41.624818 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3fe2f4e9-098f-4b5b-a251-b2522505f8ab tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:41.625508 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3fe2f4e9-098f-4b5b-a251-b2522505f8ab tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:41.625966 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3fe2f4e9-098f-4b5b-a251-b2522505f8ab tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:41.626388 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3fe2f4e9-098f-4b5b-a251-b2522505f8ab tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:41.631169 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-497bb425-d9e4-44bf-a1bd-9b359620df93 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Going to run 1 instances... {{(pid=117837) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 14:36:41.633507 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-497bb425-d9e4-44bf-a1bd-9b359620df93 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6d80056a-5ade-4f3b-8e08-adf707c34cfe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='13d7ee60-c9c3-43ee-9861-a9192a114a77',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117837) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 14:36:41.681055 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR oslo.messaging._drivers.impl_rabbit [None req-497bb425-d9e4-44bf-a1bd-9b359620df93 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [ca80ca8b-540c-43fb-84da-f664732c56c6] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 06 14:36:41.755909 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-3fe2f4e9-098f-4b5b-a251-b2522505f8ab tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:41.764280 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-3fe2f4e9-098f-4b5b-a251-b2522505f8ab tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:41.765784 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-3fe2f4e9-098f-4b5b-a251-b2522505f8ab tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:41.766960 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-3fe2f4e9-098f-4b5b-a251-b2522505f8ab tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1725 microversion: 2.20 time: 0.155875 Aug 06 14:36:41.767510 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 375/797] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:36:41 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 14:36:42.691221 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO oslo.messaging._drivers.impl_rabbit [None req-497bb425-d9e4-44bf-a1bd-9b359620df93 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [ca80ca8b-540c-43fb-84da-f664732c56c6] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 46492. Aug 06 14:36:42.695551 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-497bb425-d9e4-44bf-a1bd-9b359620df93 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.676390 Aug 06 14:36:42.696204 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 423/798] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Aug 6 14:36:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 1678 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 14:36:42.707266 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-88441d52-b082-447c-aba4-25ad5ff290c8 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:42.709799 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-88441d52-b082-447c-aba4-25ad5ff290c8 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6d80056a-5ade-4f3b-8e08-adf707c34cfe] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:42.780654 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-88441d52-b082-447c-aba4-25ad5ff290c8 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:42.789820 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-88441d52-b082-447c-aba4-25ad5ff290c8 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/6d80056a-5ade-4f3b-8e08-adf707c34cfe" status: 200 len: 1242 microversion: 2.1 time: 0.086598 Aug 06 14:36:42.790105 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-dc5579a6-dac7-4fcd-8ae6-2862d53b1db8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:42.790717 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-dc5579a6-dac7-4fcd-8ae6-2862d53b1db8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:42.797551 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-dc5579a6-dac7-4fcd-8ae6-2862d53b1db8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:42.798260 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-dc5579a6-dac7-4fcd-8ae6-2862d53b1db8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:42.798697 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-dc5579a6-dac7-4fcd-8ae6-2862d53b1db8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:42.799421 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-dc5579a6-dac7-4fcd-8ae6-2862d53b1db8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:42.799879 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-dc5579a6-dac7-4fcd-8ae6-2862d53b1db8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:42.800305 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-dc5579a6-dac7-4fcd-8ae6-2862d53b1db8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:42.804440 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 376/799] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:36:42 2022] GET /compute/v2.1/servers/6d80056a-5ade-4f3b-8e08-adf707c34cfe => generated 1242 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:36:42.952803 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-dc5579a6-dac7-4fcd-8ae6-2862d53b1db8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:42.961607 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-dc5579a6-dac7-4fcd-8ae6-2862d53b1db8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:42.963347 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-dc5579a6-dac7-4fcd-8ae6-2862d53b1db8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:42.964642 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-dc5579a6-dac7-4fcd-8ae6-2862d53b1db8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1725 microversion: 2.20 time: 0.178375 Aug 06 14:36:42.981372 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 424/800] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:36:42 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1725 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 14:36:43.590378 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [req-2fe9da86-db6a-4f42-a6c2-4db2802a4ffe req-93ee49ec-88f9-4652-b164-5b2b844a5459 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cf29bae-83f8-43e3-9118-0fea5a019ff8", "name": "network-vif-deleted", "tag": "988ecdda-956b-4c8b-8ee4-231ef3ed0bb2"}]} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:36:43.601624 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-2fe9da86-db6a-4f42-a6c2-4db2802a4ffe req-93ee49ec-88f9-4652-b164-5b2b844a5459 service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:43.602095 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-2fe9da86-db6a-4f42-a6c2-4db2802a4ffe req-93ee49ec-88f9-4652-b164-5b2b844a5459 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:43.602519 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-2fe9da86-db6a-4f42-a6c2-4db2802a4ffe req-93ee49ec-88f9-4652-b164-5b2b844a5459 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:43.613333 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.compute.server_external_events [req-2fe9da86-db6a-4f42-a6c2-4db2802a4ffe req-93ee49ec-88f9-4652-b164-5b2b844a5459 service nova] Creating event network-vif-deleted:988ecdda-956b-4c8b-8ee4-231ef3ed0bb2 for instance 5cf29bae-83f8-43e3-9118-0fea5a019ff8 on hv-cinder-85199 Aug 06 14:36:43.618514 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [req-2fe9da86-db6a-4f42-a6c2-4db2802a4ffe req-93ee49ec-88f9-4652-b164-5b2b844a5459 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031772 Aug 06 14:36:43.619121 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 377/801] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:36:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:36:43.818750 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-ad91c043-626e-43de-abdc-a16795826337 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:43.819336 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-ad91c043-626e-43de-abdc-a16795826337 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6d80056a-5ade-4f3b-8e08-adf707c34cfe] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:43.826608 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ad91c043-626e-43de-abdc-a16795826337 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:43.827154 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ad91c043-626e-43de-abdc-a16795826337 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:43.827572 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ad91c043-626e-43de-abdc-a16795826337 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:43.828405 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ad91c043-626e-43de-abdc-a16795826337 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:43.828863 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ad91c043-626e-43de-abdc-a16795826337 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:43.829423 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ad91c043-626e-43de-abdc-a16795826337 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:43.898931 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-ad91c043-626e-43de-abdc-a16795826337 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:43.912915 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-ad91c043-626e-43de-abdc-a16795826337 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/6d80056a-5ade-4f3b-8e08-adf707c34cfe" status: 200 len: 1294 microversion: 2.1 time: 0.103910 Aug 06 14:36:43.914798 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 425/802] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:36:43 2022] GET /compute/v2.1/servers/6d80056a-5ade-4f3b-8e08-adf707c34cfe => generated 1294 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:36:43.994681 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-b0a41917-41e3-4d61-a143-88f9e3ace22d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:43.995929 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-b0a41917-41e3-4d61-a143-88f9e3ace22d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:44.004943 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b0a41917-41e3-4d61-a143-88f9e3ace22d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:44.005430 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b0a41917-41e3-4d61-a143-88f9e3ace22d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:44.005915 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b0a41917-41e3-4d61-a143-88f9e3ace22d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:44.006637 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b0a41917-41e3-4d61-a143-88f9e3ace22d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:44.007133 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b0a41917-41e3-4d61-a143-88f9e3ace22d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:44.007551 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b0a41917-41e3-4d61-a143-88f9e3ace22d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:44.038901 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b0a41917-41e3-4d61-a143-88f9e3ace22d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:44.039397 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b0a41917-41e3-4d61-a143-88f9e3ace22d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:44.039824 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b0a41917-41e3-4d61-a143-88f9e3ace22d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:44.040309 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.objects.instance [None req-b0a41917-41e3-4d61-a143-88f9e3ace22d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lazy-loading 'fault' on Instance uuid 5cf29bae-83f8-43e3-9118-0fea5a019ff8 {{(pid=117838) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 14:36:44.150608 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-b0a41917-41e3-4d61-a143-88f9e3ace22d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:44.159543 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-b0a41917-41e3-4d61-a143-88f9e3ace22d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:44.161284 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-b0a41917-41e3-4d61-a143-88f9e3ace22d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:44.162431 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-b0a41917-41e3-4d61-a143-88f9e3ace22d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 200 len: 1372 microversion: 2.20 time: 0.175875 Aug 06 14:36:44.163159 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 378/803] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:36:43 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 1372 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 14:36:44.936014 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-790acd5f-3ba8-4bbf-8b61-a20d9bc3dba3 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:44.936635 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-790acd5f-3ba8-4bbf-8b61-a20d9bc3dba3 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6d80056a-5ade-4f3b-8e08-adf707c34cfe] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:44.943051 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-790acd5f-3ba8-4bbf-8b61-a20d9bc3dba3 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:44.943537 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-790acd5f-3ba8-4bbf-8b61-a20d9bc3dba3 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:44.943979 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-790acd5f-3ba8-4bbf-8b61-a20d9bc3dba3 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:44.944673 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-790acd5f-3ba8-4bbf-8b61-a20d9bc3dba3 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:44.945126 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-790acd5f-3ba8-4bbf-8b61-a20d9bc3dba3 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:44.945550 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-790acd5f-3ba8-4bbf-8b61-a20d9bc3dba3 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:45.093572 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-790acd5f-3ba8-4bbf-8b61-a20d9bc3dba3 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:45.101608 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-790acd5f-3ba8-4bbf-8b61-a20d9bc3dba3 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/6d80056a-5ade-4f3b-8e08-adf707c34cfe" status: 200 len: 1368 microversion: 2.1 time: 0.169753 Aug 06 14:36:45.102412 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 426/804] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:36:44 2022] GET /compute/v2.1/servers/6d80056a-5ade-4f3b-8e08-adf707c34cfe => generated 1368 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:36:45.191388 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-3a8e1e32-3f42-4dfa-8dfc-8f71f283e6be tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:45.197229 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-3a8e1e32-3f42-4dfa-8dfc-8f71f283e6be tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:45.206317 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3a8e1e32-3f42-4dfa-8dfc-8f71f283e6be tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:45.206804 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3a8e1e32-3f42-4dfa-8dfc-8f71f283e6be tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:45.207268 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3a8e1e32-3f42-4dfa-8dfc-8f71f283e6be tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:45.207965 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3a8e1e32-3f42-4dfa-8dfc-8f71f283e6be tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:45.208420 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3a8e1e32-3f42-4dfa-8dfc-8f71f283e6be tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:45.208838 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3a8e1e32-3f42-4dfa-8dfc-8f71f283e6be tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:45.223364 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.wsgi [None req-3a8e1e32-3f42-4dfa-8dfc-8f71f283e6be tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] HTTP exception thrown: Instance 5cf29bae-83f8-43e3-9118-0fea5a019ff8 could not be found. Aug 06 14:36:45.225250 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-3a8e1e32-3f42-4dfa-8dfc-8f71f283e6be tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Request method failure captured: Aug 06 14:36:45.225250 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: request: GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 HTTP/1.1 Aug 06 14:36:45.225250 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Accept: application/json Aug 06 14:36:45.225250 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Accept-Encoding: identity Aug 06 14:36:45.225250 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Connection: close Aug 06 14:36:45.225250 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Content-Length: 0 Aug 06 14:36:45.225250 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Content-Type: application/json Aug 06 14:36:45.225250 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Host: 10.222.0.17 Aug 06 14:36:45.225250 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Openstack-System-Scope: None Aug 06 14:36:45.225250 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: User-Agent: python-urllib3/1.26.11 Aug 06 14:36:45.225250 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Auth-Token: gAAAAABi7nrq6tL7qiEJGlB3Mk3s36rji_pwLVPV4k0GgsWA99mXI_y6g9OvbW0iTkcSI4eVLu8m4Uu6E06JohWe_gts8lqm_nQN_ZSYF4Wq4WDw9ivys9iDdeMKPqbYBg05mVkiTi8aRdnZ5sTNWZ_8t6O0DccYDCKnIxAGxbXKyLNLWp6EiMQ Aug 06 14:36:45.225250 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Domain-Id: None Aug 06 14:36:45.225250 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Domain-Name: None Aug 06 14:36:45.225250 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Identity-Status: Confirmed Aug 06 14:36:45.225250 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Is-Admin-Project: True Aug 06 14:36:45.225250 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Openstack-Nova-Api-Version: 2.20 Aug 06 14:36:45.225250 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Domain-Id: default Aug 06 14:36:45.225250 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Domain-Name: Default Aug 06 14:36:45.225250 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Id: 2f20dc7bdc3a4448a56a76f1efbec596 Aug 06 14:36:45.225250 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-536291305 Aug 06 14:36:45.225250 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Role: member,reader Aug 06 14:36:45.225250 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Roles: member,reader Aug 06 14:36:45.226700 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2f20dc7bdc3a4448a56a76f1efbec596"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2f20dc7bdc3a4448a56a76f1efbec596"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2f20dc7bdc3a4448a56a76f1efbec596", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2f20dc7bdc3a4448a56a76f1efbec596"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 06 14:36:45.226700 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Tenant: tempest-AttachVolumeShelveTestJSON-536291305 Aug 06 14:36:45.226700 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Tenant-Id: 2f20dc7bdc3a4448a56a76f1efbec596 Aug 06 14:36:45.226700 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-536291305 Aug 06 14:36:45.226700 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User: tempest-AttachVolumeShelveTestJSON-536291305-project Aug 06 14:36:45.226700 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Domain-Id: default Aug 06 14:36:45.226700 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Domain-Name: Default Aug 06 14:36:45.226700 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Id: be34f77da4d8407e9a4333bc71f64595 Aug 06 14:36:45.226700 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Name: tempest-AttachVolumeShelveTestJSON-536291305-project Aug 06 14:36:45.226700 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: method: > Aug 06 14:36:45.226700 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: exception: Instance 5cf29bae-83f8-43e3-9118-0fea5a019ff8 could not be found. Aug 06 14:36:45.226700 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: action_args: {'id': '5cf29bae-83f8-43e3-9118-0fea5a019ff8'} Aug 06 14:36:45.227721 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 14:36:45.227721 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:36:45.227721 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 14:36:45.227721 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 14:36:45.227721 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 14:36:45.227721 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 14:36:45.227721 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 14:36:45.227721 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 14:36:45.227721 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 14:36:45.227721 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 14:36:45.227721 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cf29bae-83f8-43e3-9118-0fea5a019ff8 could not be found. Aug 06 14:36:45.227721 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:36:45.227721 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:36:45.227721 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:36:45.227721 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:36:45.227721 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:36:45.227721 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:36:45.227721 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 14:36:45.227721 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 14:36:45.227721 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 14:36:45.229250 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 14:36:45.229250 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 14:36:45.229250 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 14:36:45.229250 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 14:36:45.229250 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 14:36:45.229250 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 14:36:45.229250 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 14:36:45.229250 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cf29bae-83f8-43e3-9118-0fea5a019ff8 could not be found. Aug 06 14:36:45.229250 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:36:45.229250 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:36:45.229250 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:36:45.229250 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:36:45.229250 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:36:45.229250 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:36:45.229250 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 14:36:45.229250 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 14:36:45.229250 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cf29bae-83f8-43e3-9118-0fea5a019ff8 could not be found. Aug 06 14:36:45.229250 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:36:45.232258 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-3a8e1e32-3f42-4dfa-8dfc-8f71f283e6be tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Returning 404 to user: Instance 5cf29bae-83f8-43e3-9118-0fea5a019ff8 could not be found. {{(pid=117838) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 14:36:45.232258 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-3a8e1e32-3f42-4dfa-8dfc-8f71f283e6be tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 404 len: 111 microversion: 2.20 time: 0.044843 Aug 06 14:36:45.232258 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 379/805] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:36:45 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 06 14:36:45.235954 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-5badfd07-624a-4897-a2d6-170fb38ff780 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '.version_select at 0x7fbab5dc9ca0>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:45.257892 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-5badfd07-624a-4897-a2d6-170fb38ff780 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1787915652" status: 204 len: 0 microversion: 2.20 time: 0.026034 Aug 06 14:36:45.258966 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 427/806] 10.222.0.17 () {60 vars in 1262 bytes} [Sat Aug 6 14:36:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1787915652 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 06 14:36:45.653336 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [req-7b0a7306-6a69-4275-8a97-f57760e74ceb req-4c6c5f57-36d4-4d8b-8dc9-3be5483f7958 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d80056a-5ade-4f3b-8e08-adf707c34cfe", "tag": "82b5d66c-2905-491d-8557-b611c573deda"}]} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:36:45.663260 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-7b0a7306-6a69-4275-8a97-f57760e74ceb req-4c6c5f57-36d4-4d8b-8dc9-3be5483f7958 service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:45.663979 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-7b0a7306-6a69-4275-8a97-f57760e74ceb req-4c6c5f57-36d4-4d8b-8dc9-3be5483f7958 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:45.664405 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-7b0a7306-6a69-4275-8a97-f57760e74ceb req-4c6c5f57-36d4-4d8b-8dc9-3be5483f7958 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:45.691124 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.compute.server_external_events [req-7b0a7306-6a69-4275-8a97-f57760e74ceb req-4c6c5f57-36d4-4d8b-8dc9-3be5483f7958 service nova] Creating event network-changed:82b5d66c-2905-491d-8557-b611c573deda for instance 6d80056a-5ade-4f3b-8e08-adf707c34cfe on hv-cinder-85199 Aug 06 14:36:45.696115 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [req-7b0a7306-6a69-4275-8a97-f57760e74ceb req-4c6c5f57-36d4-4d8b-8dc9-3be5483f7958 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046555 Aug 06 14:36:45.696944 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 380/807] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:36:45.937432 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-b2081a84-3882-4111-a9b0-2b6218eb84f7 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Action: 'create', calling method: .version_select at 0x7fbab0d3a820>, body: {"keypair": {"name": "tempest-keypair-2025997875", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN/50z8qwXhChvbRRe2LrnH/abSWy5Lc9b1vYXjvmxmfH+9v5NtFrg4BTEg3pTDLdyS0/BFRseZ4aqHvjUWPeCWh95y3iwxFIiXuZPzs2sQ1v+aAu34qikEKykwNCPw0dQ=="}} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:36:45.953752 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.quota [None req-b2081a84-3882-4111-a9b0-2b6218eb84f7 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Getting quotas for project 2f20dc7bdc3a4448a56a76f1efbec596. Resources: {'key_pairs'} {{(pid=117837) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 14:36:45.957647 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.quota [None req-b2081a84-3882-4111-a9b0-2b6218eb84f7 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Getting quotas for user be34f77da4d8407e9a4333bc71f64595 and project 2f20dc7bdc3a4448a56a76f1efbec596. Resources: {'key_pairs'} {{(pid=117837) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 14:36:45.981706 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-b2081a84-3882-4111-a9b0-2b6218eb84f7 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.047774 Aug 06 14:36:45.982501 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 428/808] 10.222.0.17 () {62 vars in 1200 bytes} [Sat Aug 6 14:36:45 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 50 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 06 14:36:46.123664 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-33bf70c4-ff80-4d1f-8549-524976f16b20 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:46.124361 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-33bf70c4-ff80-4d1f-8549-524976f16b20 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6d80056a-5ade-4f3b-8e08-adf707c34cfe] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:46.131432 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-33bf70c4-ff80-4d1f-8549-524976f16b20 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:46.132133 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-33bf70c4-ff80-4d1f-8549-524976f16b20 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:46.132727 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-33bf70c4-ff80-4d1f-8549-524976f16b20 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:46.133622 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-33bf70c4-ff80-4d1f-8549-524976f16b20 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:46.134079 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-33bf70c4-ff80-4d1f-8549-524976f16b20 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:46.134725 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-33bf70c4-ff80-4d1f-8549-524976f16b20 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:46.317711 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-33bf70c4-ff80-4d1f-8549-524976f16b20 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:46.325847 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-33bf70c4-ff80-4d1f-8549-524976f16b20 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/6d80056a-5ade-4f3b-8e08-adf707c34cfe" status: 200 len: 1368 microversion: 2.1 time: 0.206777 Aug 06 14:36:46.326410 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 381/809] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:36:46 2022] GET /compute/v2.1/servers/6d80056a-5ade-4f3b-8e08-adf707c34cfe => generated 1368 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:36:47.325997 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-0c37c87f-434d-4ad9-ac39-ecd5fc51f9ea tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1317365681", "imageRef": "13d7ee60-c9c3-43ee-9861-a9192a114a77", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e572c0f4-0bb9-43af-bf1a-152c1e064c44"}], "security_groups": [{"name": "tempest-securitygroup--1248981601"}], "key_name": "tempest-keypair-2025997875", "user_data": "}} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:36:47.346904 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-6e77c4cd-1b48-4cbf-a3e7-e568879347ce tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:47.347500 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-6e77c4cd-1b48-4cbf-a3e7-e568879347ce tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6d80056a-5ade-4f3b-8e08-adf707c34cfe] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:47.353842 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6e77c4cd-1b48-4cbf-a3e7-e568879347ce tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:47.354316 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6e77c4cd-1b48-4cbf-a3e7-e568879347ce tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:47.354742 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6e77c4cd-1b48-4cbf-a3e7-e568879347ce tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:47.355454 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6e77c4cd-1b48-4cbf-a3e7-e568879347ce tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:47.356518 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6e77c4cd-1b48-4cbf-a3e7-e568879347ce tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:47.356948 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6e77c4cd-1b48-4cbf-a3e7-e568879347ce tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:47.428260 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.network.neutron [None req-0c37c87f-434d-4ad9-ac39-ecd5fc51f9ea tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] validate_networks() for [('e572c0f4-0bb9-43af-bf1a-152c1e064c44', None, None, None, None, None)] {{(pid=117837) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 14:36:47.487606 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-6e77c4cd-1b48-4cbf-a3e7-e568879347ce tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:47.494917 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-6e77c4cd-1b48-4cbf-a3e7-e568879347ce tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/6d80056a-5ade-4f3b-8e08-adf707c34cfe" status: 200 len: 1368 microversion: 2.1 time: 0.151769 Aug 06 14:36:47.495494 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 382/810] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:36:47 2022] GET /compute/v2.1/servers/6d80056a-5ade-4f3b-8e08-adf707c34cfe => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:36:47.790019 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.virt.hardware [None req-0c37c87f-434d-4ad9-ac39-ecd5fc51f9ea tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Flavor limits 0:0:0 {{(pid=117837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 14:36:47.790438 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.virt.hardware [None req-0c37c87f-434d-4ad9-ac39-ecd5fc51f9ea tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Image limits 0:0:0 {{(pid=117837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 14:36:47.790931 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.virt.hardware [None req-0c37c87f-434d-4ad9-ac39-ecd5fc51f9ea tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Flavor pref 0:0:0 {{(pid=117837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 14:36:47.791341 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.virt.hardware [None req-0c37c87f-434d-4ad9-ac39-ecd5fc51f9ea tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Image pref 0:0:0 {{(pid=117837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 14:36:47.791777 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.virt.hardware [None req-0c37c87f-434d-4ad9-ac39-ecd5fc51f9ea tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 14:36:47.800388 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0c37c87f-434d-4ad9-ac39-ecd5fc51f9ea tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:47.800864 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0c37c87f-434d-4ad9-ac39-ecd5fc51f9ea tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:47.801295 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0c37c87f-434d-4ad9-ac39-ecd5fc51f9ea tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:47.802011 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0c37c87f-434d-4ad9-ac39-ecd5fc51f9ea tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:47.802460 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0c37c87f-434d-4ad9-ac39-ecd5fc51f9ea tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:47.802895 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0c37c87f-434d-4ad9-ac39-ecd5fc51f9ea tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:47.819293 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.quota [None req-0c37c87f-434d-4ad9-ac39-ecd5fc51f9ea tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Getting quotas for project 2f20dc7bdc3a4448a56a76f1efbec596. Resources: {'cores', 'instances', 'ram'} {{(pid=117837) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 14:36:47.823000 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.quota [None req-0c37c87f-434d-4ad9-ac39-ecd5fc51f9ea tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Getting quotas for user be34f77da4d8407e9a4333bc71f64595 and project 2f20dc7bdc3a4448a56a76f1efbec596. Resources: {'cores', 'instances', 'ram'} {{(pid=117837) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 14:36:47.834212 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-0c37c87f-434d-4ad9-ac39-ecd5fc51f9ea tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Going to run 1 instances... {{(pid=117837) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 14:36:47.836327 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-0c37c87f-434d-4ad9-ac39-ecd5fc51f9ea tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='13d7ee60-c9c3-43ee-9861-a9192a114a77',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117837) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 14:36:47.881402 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-0c37c87f-434d-4ad9-ac39-ecd5fc51f9ea tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.559634 Aug 06 14:36:47.882049 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 429/811] 10.222.0.17 () {62 vars in 1188 bytes} [Sat Aug 6 14:36:47 2022] POST /compute/v2.1/servers => generated 402 bytes in 561 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 06 14:36:47.893218 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-dc1aea2f-cdd1-4507-9937-df88272a80a8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:47.893821 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-dc1aea2f-cdd1-4507-9937-df88272a80a8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:47.953375 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-dc1aea2f-cdd1-4507-9937-df88272a80a8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:47.960574 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-dc1aea2f-cdd1-4507-9937-df88272a80a8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:47.962083 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-dc1aea2f-cdd1-4507-9937-df88272a80a8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:47.963205 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-dc1aea2f-cdd1-4507-9937-df88272a80a8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e" status: 200 len: 1282 microversion: 2.20 time: 0.073826 Aug 06 14:36:47.963767 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 383/812] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:36:47 2022] GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e => generated 1282 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:36:48.515750 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-8a8e9ff8-a5df-4f5b-8688-e978c99a286d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:48.516288 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-8a8e9ff8-a5df-4f5b-8688-e978c99a286d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6d80056a-5ade-4f3b-8e08-adf707c34cfe] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:48.524765 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8a8e9ff8-a5df-4f5b-8688-e978c99a286d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:48.525270 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8a8e9ff8-a5df-4f5b-8688-e978c99a286d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:48.525707 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8a8e9ff8-a5df-4f5b-8688-e978c99a286d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:48.526389 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8a8e9ff8-a5df-4f5b-8688-e978c99a286d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:48.526836 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8a8e9ff8-a5df-4f5b-8688-e978c99a286d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:48.527286 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8a8e9ff8-a5df-4f5b-8688-e978c99a286d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:48.652465 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-8a8e9ff8-a5df-4f5b-8688-e978c99a286d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:48.659719 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-8a8e9ff8-a5df-4f5b-8688-e978c99a286d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/6d80056a-5ade-4f3b-8e08-adf707c34cfe" status: 200 len: 1368 microversion: 2.1 time: 0.148355 Aug 06 14:36:48.660269 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 430/813] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:36:48 2022] GET /compute/v2.1/servers/6d80056a-5ade-4f3b-8e08-adf707c34cfe => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:36:48.987466 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-5ca8a7ad-61f6-48e7-a5a0-25fc9813fd98 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:48.988201 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-5ca8a7ad-61f6-48e7-a5a0-25fc9813fd98 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:48.995057 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5ca8a7ad-61f6-48e7-a5a0-25fc9813fd98 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:48.995533 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5ca8a7ad-61f6-48e7-a5a0-25fc9813fd98 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:48.995970 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5ca8a7ad-61f6-48e7-a5a0-25fc9813fd98 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:48.996963 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5ca8a7ad-61f6-48e7-a5a0-25fc9813fd98 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:48.997413 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5ca8a7ad-61f6-48e7-a5a0-25fc9813fd98 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:48.997831 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5ca8a7ad-61f6-48e7-a5a0-25fc9813fd98 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:49.002539 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:36:49.060299 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-5ca8a7ad-61f6-48e7-a5a0-25fc9813fd98 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:49.068016 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-5ca8a7ad-61f6-48e7-a5a0-25fc9813fd98 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:49.069589 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-5ca8a7ad-61f6-48e7-a5a0-25fc9813fd98 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:49.070675 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-5ca8a7ad-61f6-48e7-a5a0-25fc9813fd98 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e" status: 200 len: 1334 microversion: 2.20 time: 0.088379 Aug 06 14:36:49.071253 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 384/814] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:36:48 2022] GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e => generated 1334 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:36:49.221242 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 14:36:49.221452 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Sat Aug 6 14:36:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 14:36:49.680172 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-56efcc01-24ce-4a6b-a486-76d346428e37 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:49.680776 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-56efcc01-24ce-4a6b-a486-76d346428e37 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6d80056a-5ade-4f3b-8e08-adf707c34cfe] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:49.687845 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-56efcc01-24ce-4a6b-a486-76d346428e37 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:49.688323 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-56efcc01-24ce-4a6b-a486-76d346428e37 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:49.688751 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-56efcc01-24ce-4a6b-a486-76d346428e37 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:49.689431 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-56efcc01-24ce-4a6b-a486-76d346428e37 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:49.689877 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-56efcc01-24ce-4a6b-a486-76d346428e37 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:49.690296 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-56efcc01-24ce-4a6b-a486-76d346428e37 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:49.895702 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-56efcc01-24ce-4a6b-a486-76d346428e37 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:49.903481 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-56efcc01-24ce-4a6b-a486-76d346428e37 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/6d80056a-5ade-4f3b-8e08-adf707c34cfe" status: 200 len: 1368 microversion: 2.1 time: 0.227045 Aug 06 14:36:49.904226 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 431/815] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:36:49 2022] GET /compute/v2.1/servers/6d80056a-5ade-4f3b-8e08-adf707c34cfe => generated 1368 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:36:50.093267 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-65e21740-fbdc-4300-8c5e-ab145ec4cf12 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:50.093879 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-65e21740-fbdc-4300-8c5e-ab145ec4cf12 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:50.100189 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-65e21740-fbdc-4300-8c5e-ab145ec4cf12 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:50.100668 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-65e21740-fbdc-4300-8c5e-ab145ec4cf12 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:50.101102 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-65e21740-fbdc-4300-8c5e-ab145ec4cf12 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:50.101797 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-65e21740-fbdc-4300-8c5e-ab145ec4cf12 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:50.102265 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-65e21740-fbdc-4300-8c5e-ab145ec4cf12 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:50.102663 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-65e21740-fbdc-4300-8c5e-ab145ec4cf12 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:50.166111 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-65e21740-fbdc-4300-8c5e-ab145ec4cf12 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:50.174530 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-65e21740-fbdc-4300-8c5e-ab145ec4cf12 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:50.176068 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-65e21740-fbdc-4300-8c5e-ab145ec4cf12 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:50.177171 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-65e21740-fbdc-4300-8c5e-ab145ec4cf12 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e" status: 200 len: 1340 microversion: 2.20 time: 0.087874 Aug 06 14:36:50.177751 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 385/816] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:36:50 2022] GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e => generated 1340 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:36:50.915364 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [req-729ddb8b-12ca-4b98-977e-c79cf88fc82e req-5a2b6257-c375-4850-9685-7cca47df43b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91e50552-3108-4fca-82ca-e299af40061e", "tag": "d910f3cd-711d-43f7-8b9c-b79ca1e620bd"}]} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:36:50.925939 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-729ddb8b-12ca-4b98-977e-c79cf88fc82e req-5a2b6257-c375-4850-9685-7cca47df43b5 service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:50.926315 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-3949dafd-303a-4978-a6c2-42b6a36a9e38 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:50.926992 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-3949dafd-303a-4978-a6c2-42b6a36a9e38 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6d80056a-5ade-4f3b-8e08-adf707c34cfe] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:50.928753 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-729ddb8b-12ca-4b98-977e-c79cf88fc82e req-5a2b6257-c375-4850-9685-7cca47df43b5 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:50.928753 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-729ddb8b-12ca-4b98-977e-c79cf88fc82e req-5a2b6257-c375-4850-9685-7cca47df43b5 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:50.934304 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3949dafd-303a-4978-a6c2-42b6a36a9e38 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:50.934943 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3949dafd-303a-4978-a6c2-42b6a36a9e38 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:50.935655 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3949dafd-303a-4978-a6c2-42b6a36a9e38 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:50.936422 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3949dafd-303a-4978-a6c2-42b6a36a9e38 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:50.937228 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3949dafd-303a-4978-a6c2-42b6a36a9e38 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:50.937729 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3949dafd-303a-4978-a6c2-42b6a36a9e38 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:50.940104 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.compute.server_external_events [req-729ddb8b-12ca-4b98-977e-c79cf88fc82e req-5a2b6257-c375-4850-9685-7cca47df43b5 service nova] Creating event network-changed:d910f3cd-711d-43f7-8b9c-b79ca1e620bd for instance 91e50552-3108-4fca-82ca-e299af40061e on hv-cinder-85199 Aug 06 14:36:50.944939 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [req-729ddb8b-12ca-4b98-977e-c79cf88fc82e req-5a2b6257-c375-4850-9685-7cca47df43b5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033260 Aug 06 14:36:50.945797 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 432/817] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:36:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 14:36:51.085132 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-3949dafd-303a-4978-a6c2-42b6a36a9e38 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:51.092620 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-3949dafd-303a-4978-a6c2-42b6a36a9e38 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/6d80056a-5ade-4f3b-8e08-adf707c34cfe" status: 200 len: 1368 microversion: 2.1 time: 0.171157 Aug 06 14:36:51.093174 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 386/818] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:36:50 2022] GET /compute/v2.1/servers/6d80056a-5ade-4f3b-8e08-adf707c34cfe => generated 1368 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:36:51.201659 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-3c566648-01ac-4978-b12b-1cf90cc771cb tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:51.202437 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-3c566648-01ac-4978-b12b-1cf90cc771cb tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:51.209434 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-3c566648-01ac-4978-b12b-1cf90cc771cb tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:51.210029 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-3c566648-01ac-4978-b12b-1cf90cc771cb tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:51.210529 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-3c566648-01ac-4978-b12b-1cf90cc771cb tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:51.211315 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-3c566648-01ac-4978-b12b-1cf90cc771cb tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:51.212284 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-3c566648-01ac-4978-b12b-1cf90cc771cb tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:51.212284 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-3c566648-01ac-4978-b12b-1cf90cc771cb tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:51.424389 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-3c566648-01ac-4978-b12b-1cf90cc771cb tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:51.432525 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-3c566648-01ac-4978-b12b-1cf90cc771cb tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:51.434603 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-3c566648-01ac-4978-b12b-1cf90cc771cb tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:51.435756 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-3c566648-01ac-4978-b12b-1cf90cc771cb tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e" status: 200 len: 1408 microversion: 2.20 time: 0.238750 Aug 06 14:36:51.436535 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 433/819] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:36:51 2022] GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e => generated 1408 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:36:52.113194 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-6833b105-c9f3-49a9-8c3f-9af1771d16f5 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:52.113755 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-6833b105-c9f3-49a9-8c3f-9af1771d16f5 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6d80056a-5ade-4f3b-8e08-adf707c34cfe] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:52.120364 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6833b105-c9f3-49a9-8c3f-9af1771d16f5 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:52.120839 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6833b105-c9f3-49a9-8c3f-9af1771d16f5 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:52.121312 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6833b105-c9f3-49a9-8c3f-9af1771d16f5 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:52.121989 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6833b105-c9f3-49a9-8c3f-9af1771d16f5 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:52.122434 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6833b105-c9f3-49a9-8c3f-9af1771d16f5 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:52.122850 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6833b105-c9f3-49a9-8c3f-9af1771d16f5 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:52.252157 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-6833b105-c9f3-49a9-8c3f-9af1771d16f5 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:52.259455 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-6833b105-c9f3-49a9-8c3f-9af1771d16f5 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/6d80056a-5ade-4f3b-8e08-adf707c34cfe" status: 200 len: 1368 microversion: 2.1 time: 0.150498 Aug 06 14:36:52.260018 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 387/820] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:36:52 2022] GET /compute/v2.1/servers/6d80056a-5ade-4f3b-8e08-adf707c34cfe => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:36:52.457402 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-0bdec6a0-127f-42ba-813e-35cc47ad9416 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:52.458013 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-0bdec6a0-127f-42ba-813e-35cc47ad9416 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:52.464378 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0bdec6a0-127f-42ba-813e-35cc47ad9416 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:52.465460 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0bdec6a0-127f-42ba-813e-35cc47ad9416 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:52.465900 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0bdec6a0-127f-42ba-813e-35cc47ad9416 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:52.466615 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0bdec6a0-127f-42ba-813e-35cc47ad9416 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:52.467094 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0bdec6a0-127f-42ba-813e-35cc47ad9416 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:52.467519 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0bdec6a0-127f-42ba-813e-35cc47ad9416 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:52.594789 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-0bdec6a0-127f-42ba-813e-35cc47ad9416 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:52.602686 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-0bdec6a0-127f-42ba-813e-35cc47ad9416 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:52.604194 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-0bdec6a0-127f-42ba-813e-35cc47ad9416 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:52.605286 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-0bdec6a0-127f-42ba-813e-35cc47ad9416 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e" status: 200 len: 1408 microversion: 2.20 time: 0.151784 Aug 06 14:36:52.605878 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 434/821] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:36:52 2022] GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e => generated 1408 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:36:52.978157 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [req-92a58a24-26c9-4527-9618-e1e328694810 req-37c8ebab-f8b9-41f5-a047-b95456227af5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d80056a-5ade-4f3b-8e08-adf707c34cfe", "name": "network-vif-plugged", "status": "completed", "tag": "82b5d66c-2905-491d-8557-b611c573deda"}]} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:36:52.988136 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-92a58a24-26c9-4527-9618-e1e328694810 req-37c8ebab-f8b9-41f5-a047-b95456227af5 service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:52.988613 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-92a58a24-26c9-4527-9618-e1e328694810 req-37c8ebab-f8b9-41f5-a047-b95456227af5 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:52.989051 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-92a58a24-26c9-4527-9618-e1e328694810 req-37c8ebab-f8b9-41f5-a047-b95456227af5 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:53.003852 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.compute.server_external_events [req-92a58a24-26c9-4527-9618-e1e328694810 req-37c8ebab-f8b9-41f5-a047-b95456227af5 service nova] Creating event network-vif-plugged:82b5d66c-2905-491d-8557-b611c573deda for instance 6d80056a-5ade-4f3b-8e08-adf707c34cfe on hv-cinder-85199 Aug 06 14:36:53.009287 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [req-92a58a24-26c9-4527-9618-e1e328694810 req-37c8ebab-f8b9-41f5-a047-b95456227af5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091157 Aug 06 14:36:53.009883 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 388/822] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:36:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:36:53.279973 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-888f5ca3-cc20-4c4c-902c-318964191b9e tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:53.280576 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-888f5ca3-cc20-4c4c-902c-318964191b9e tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6d80056a-5ade-4f3b-8e08-adf707c34cfe] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:53.286414 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-888f5ca3-cc20-4c4c-902c-318964191b9e tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:53.286908 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-888f5ca3-cc20-4c4c-902c-318964191b9e tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:53.287341 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-888f5ca3-cc20-4c4c-902c-318964191b9e tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:53.288020 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-888f5ca3-cc20-4c4c-902c-318964191b9e tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:53.288468 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-888f5ca3-cc20-4c4c-902c-318964191b9e tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:53.288887 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-888f5ca3-cc20-4c4c-902c-318964191b9e tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:53.416578 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-888f5ca3-cc20-4c4c-902c-318964191b9e tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:53.424490 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-888f5ca3-cc20-4c4c-902c-318964191b9e tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/6d80056a-5ade-4f3b-8e08-adf707c34cfe" status: 200 len: 1368 microversion: 2.1 time: 0.148808 Aug 06 14:36:53.425038 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 435/823] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:36:53 2022] GET /compute/v2.1/servers/6d80056a-5ade-4f3b-8e08-adf707c34cfe => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:36:53.628513 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-da2b23fb-cd71-4350-8f24-fa6fa675c8f6 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:53.629199 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-da2b23fb-cd71-4350-8f24-fa6fa675c8f6 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:53.635964 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-da2b23fb-cd71-4350-8f24-fa6fa675c8f6 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:53.636505 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-da2b23fb-cd71-4350-8f24-fa6fa675c8f6 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:53.637421 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-da2b23fb-cd71-4350-8f24-fa6fa675c8f6 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:53.638114 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-da2b23fb-cd71-4350-8f24-fa6fa675c8f6 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:53.638566 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-da2b23fb-cd71-4350-8f24-fa6fa675c8f6 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:53.639022 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-da2b23fb-cd71-4350-8f24-fa6fa675c8f6 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:53.764652 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-da2b23fb-cd71-4350-8f24-fa6fa675c8f6 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:53.772451 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-da2b23fb-cd71-4350-8f24-fa6fa675c8f6 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:53.773948 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-da2b23fb-cd71-4350-8f24-fa6fa675c8f6 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:53.775071 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-da2b23fb-cd71-4350-8f24-fa6fa675c8f6 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e" status: 200 len: 1408 microversion: 2.20 time: 0.150774 Aug 06 14:36:53.775627 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 389/824] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:36:53 2022] GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e => generated 1408 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:36:54.445609 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-8849cfe7-9a08-4ab9-b1b1-30c8a4d0afb1 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:54.446984 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-8849cfe7-9a08-4ab9-b1b1-30c8a4d0afb1 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6d80056a-5ade-4f3b-8e08-adf707c34cfe] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:54.453701 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8849cfe7-9a08-4ab9-b1b1-30c8a4d0afb1 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:54.454295 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8849cfe7-9a08-4ab9-b1b1-30c8a4d0afb1 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:54.454809 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8849cfe7-9a08-4ab9-b1b1-30c8a4d0afb1 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:54.455895 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8849cfe7-9a08-4ab9-b1b1-30c8a4d0afb1 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:54.456427 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8849cfe7-9a08-4ab9-b1b1-30c8a4d0afb1 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:54.456900 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8849cfe7-9a08-4ab9-b1b1-30c8a4d0afb1 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:54.784541 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-8849cfe7-9a08-4ab9-b1b1-30c8a4d0afb1 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:54.791855 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-8849cfe7-9a08-4ab9-b1b1-30c8a4d0afb1 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/6d80056a-5ade-4f3b-8e08-adf707c34cfe" status: 200 len: 1368 microversion: 2.1 time: 0.350410 Aug 06 14:36:54.797973 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-5f50f83b-1b59-4208-8be8-2105fc742f24 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:54.798570 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-5f50f83b-1b59-4208-8be8-2105fc742f24 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:54.801899 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 436/825] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:36:54 2022] GET /compute/v2.1/servers/6d80056a-5ade-4f3b-8e08-adf707c34cfe => generated 1368 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:36:54.805114 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5f50f83b-1b59-4208-8be8-2105fc742f24 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:54.805588 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5f50f83b-1b59-4208-8be8-2105fc742f24 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:54.806032 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5f50f83b-1b59-4208-8be8-2105fc742f24 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:54.806691 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5f50f83b-1b59-4208-8be8-2105fc742f24 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:54.807437 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5f50f83b-1b59-4208-8be8-2105fc742f24 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:54.807855 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5f50f83b-1b59-4208-8be8-2105fc742f24 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:54.935866 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-5f50f83b-1b59-4208-8be8-2105fc742f24 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:54.943807 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-5f50f83b-1b59-4208-8be8-2105fc742f24 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:54.945396 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-5f50f83b-1b59-4208-8be8-2105fc742f24 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:54.946605 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-5f50f83b-1b59-4208-8be8-2105fc742f24 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e" status: 200 len: 1408 microversion: 2.20 time: 0.152290 Aug 06 14:36:54.947164 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 390/826] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:36:54 2022] GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e => generated 1408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 14:36:55.813482 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-19f16093-47f3-47e8-bd4b-6b49361d0041 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:55.814089 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-19f16093-47f3-47e8-bd4b-6b49361d0041 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6d80056a-5ade-4f3b-8e08-adf707c34cfe] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:55.820566 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-19f16093-47f3-47e8-bd4b-6b49361d0041 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:55.821043 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-19f16093-47f3-47e8-bd4b-6b49361d0041 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:55.821470 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-19f16093-47f3-47e8-bd4b-6b49361d0041 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:55.822156 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-19f16093-47f3-47e8-bd4b-6b49361d0041 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:55.822610 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-19f16093-47f3-47e8-bd4b-6b49361d0041 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:55.823062 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-19f16093-47f3-47e8-bd4b-6b49361d0041 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:55.969467 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-821d3b4c-265c-4d78-85bf-15e5e84a544b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:55.970125 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-821d3b4c-265c-4d78-85bf-15e5e84a544b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:55.976729 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-821d3b4c-265c-4d78-85bf-15e5e84a544b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:55.977209 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-821d3b4c-265c-4d78-85bf-15e5e84a544b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:55.977636 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-821d3b4c-265c-4d78-85bf-15e5e84a544b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:55.978319 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-821d3b4c-265c-4d78-85bf-15e5e84a544b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:55.978775 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-821d3b4c-265c-4d78-85bf-15e5e84a544b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:55.979218 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-821d3b4c-265c-4d78-85bf-15e5e84a544b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:55.987480 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-19f16093-47f3-47e8-bd4b-6b49361d0041 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:55.994829 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-19f16093-47f3-47e8-bd4b-6b49361d0041 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/6d80056a-5ade-4f3b-8e08-adf707c34cfe" status: 200 len: 1368 microversion: 2.1 time: 0.185180 Aug 06 14:36:55.995429 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 437/827] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:36:55 2022] GET /compute/v2.1/servers/6d80056a-5ade-4f3b-8e08-adf707c34cfe => generated 1368 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:36:56.106123 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-821d3b4c-265c-4d78-85bf-15e5e84a544b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:56.113906 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-821d3b4c-265c-4d78-85bf-15e5e84a544b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:56.115434 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-821d3b4c-265c-4d78-85bf-15e5e84a544b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:56.116535 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-821d3b4c-265c-4d78-85bf-15e5e84a544b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e" status: 200 len: 1408 microversion: 2.20 time: 0.150975 Aug 06 14:36:56.117094 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 391/828] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:36:55 2022] GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e => generated 1408 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 14:36:57.016347 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-51a8940d-84fd-4ef3-9cee-bb46b5e49387 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:57.016963 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-51a8940d-84fd-4ef3-9cee-bb46b5e49387 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6d80056a-5ade-4f3b-8e08-adf707c34cfe] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:57.017747 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [req-9fc41845-b0d3-407c-b3ee-e8a0f9b7faa3 req-f329e3ae-719a-4c22-ade6-ab57d762bbba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91e50552-3108-4fca-82ca-e299af40061e", "name": "network-vif-plugged", "status": "completed", "tag": "d910f3cd-711d-43f7-8b9c-b79ca1e620bd"}]} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:36:57.023728 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-51a8940d-84fd-4ef3-9cee-bb46b5e49387 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:57.024268 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-51a8940d-84fd-4ef3-9cee-bb46b5e49387 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:57.024737 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-51a8940d-84fd-4ef3-9cee-bb46b5e49387 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:57.025454 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-51a8940d-84fd-4ef3-9cee-bb46b5e49387 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:57.025943 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-51a8940d-84fd-4ef3-9cee-bb46b5e49387 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:57.026395 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-51a8940d-84fd-4ef3-9cee-bb46b5e49387 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:57.032448 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-9fc41845-b0d3-407c-b3ee-e8a0f9b7faa3 req-f329e3ae-719a-4c22-ade6-ab57d762bbba service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:57.032937 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-9fc41845-b0d3-407c-b3ee-e8a0f9b7faa3 req-f329e3ae-719a-4c22-ade6-ab57d762bbba service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:57.033373 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-9fc41845-b0d3-407c-b3ee-e8a0f9b7faa3 req-f329e3ae-719a-4c22-ade6-ab57d762bbba service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:57.069638 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.compute.server_external_events [req-9fc41845-b0d3-407c-b3ee-e8a0f9b7faa3 req-f329e3ae-719a-4c22-ade6-ab57d762bbba service nova] Creating event network-vif-plugged:d910f3cd-711d-43f7-8b9c-b79ca1e620bd for instance 91e50552-3108-4fca-82ca-e299af40061e on hv-cinder-85199 Aug 06 14:36:57.076459 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [req-9fc41845-b0d3-407c-b3ee-e8a0f9b7faa3 req-f329e3ae-719a-4c22-ade6-ab57d762bbba service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062502 Aug 06 14:36:57.077216 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 392/829] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:36:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:36:57.141365 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-c45b9b17-39c8-4c8f-8b33-ee1a5f31567a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:57.142060 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-c45b9b17-39c8-4c8f-8b33-ee1a5f31567a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:57.149206 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c45b9b17-39c8-4c8f-8b33-ee1a5f31567a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:57.150226 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c45b9b17-39c8-4c8f-8b33-ee1a5f31567a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:57.150839 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c45b9b17-39c8-4c8f-8b33-ee1a5f31567a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:57.151596 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c45b9b17-39c8-4c8f-8b33-ee1a5f31567a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:57.152040 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c45b9b17-39c8-4c8f-8b33-ee1a5f31567a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:57.152922 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c45b9b17-39c8-4c8f-8b33-ee1a5f31567a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:57.163546 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-51a8940d-84fd-4ef3-9cee-bb46b5e49387 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:57.170943 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-51a8940d-84fd-4ef3-9cee-bb46b5e49387 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/6d80056a-5ade-4f3b-8e08-adf707c34cfe" status: 200 len: 1557 microversion: 2.1 time: 0.159113 Aug 06 14:36:57.171503 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 438/830] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:36:57 2022] GET /compute/v2.1/servers/6d80056a-5ade-4f3b-8e08-adf707c34cfe => generated 1557 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:36:57.192490 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-61b1e27e-bfa8-4a41-a983-10e2154e8193 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:57.193611 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-61b1e27e-bfa8-4a41-a983-10e2154e8193 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6d80056a-5ade-4f3b-8e08-adf707c34cfe] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:57.200758 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-61b1e27e-bfa8-4a41-a983-10e2154e8193 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:57.201346 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-61b1e27e-bfa8-4a41-a983-10e2154e8193 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:57.201780 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-61b1e27e-bfa8-4a41-a983-10e2154e8193 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:57.202482 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-61b1e27e-bfa8-4a41-a983-10e2154e8193 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:57.202967 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-61b1e27e-bfa8-4a41-a983-10e2154e8193 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:57.203395 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-61b1e27e-bfa8-4a41-a983-10e2154e8193 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:57.285704 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-61b1e27e-bfa8-4a41-a983-10e2154e8193 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/6d80056a-5ade-4f3b-8e08-adf707c34cfe/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096905 Aug 06 14:36:57.286384 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 439/831] 10.222.0.17 () {58 vars in 1275 bytes} [Sat Aug 6 14:36:57 2022] GET /compute/v2.1/servers/6d80056a-5ade-4f3b-8e08-adf707c34cfe/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 14:36:57.311870 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-c45b9b17-39c8-4c8f-8b33-ee1a5f31567a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:57.322687 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-c45b9b17-39c8-4c8f-8b33-ee1a5f31567a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:57.324889 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-c45b9b17-39c8-4c8f-8b33-ee1a5f31567a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:57.326085 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-c45b9b17-39c8-4c8f-8b33-ee1a5f31567a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e" status: 200 len: 1408 microversion: 2.20 time: 0.189801 Aug 06 14:36:57.326654 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 393/832] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:36:57 2022] GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e => generated 1408 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 14:36:58.209102 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_cell0:SELECT=4 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:36:58.209972 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_cell0:SELECT=20 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:36:58.214542 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [req-8304e214-e573-4523-9677-754c6d5867c8 req-f641c829-98ab-4afb-b65a-1c366f5a7688 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d80056a-5ade-4f3b-8e08-adf707c34cfe", "tag": "82b5d66c-2905-491d-8557-b611c573deda"}]} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:36:58.225278 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-8304e214-e573-4523-9677-754c6d5867c8 req-f641c829-98ab-4afb-b65a-1c366f5a7688 service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:58.225889 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-8304e214-e573-4523-9677-754c6d5867c8 req-f641c829-98ab-4afb-b65a-1c366f5a7688 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:58.226313 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-8304e214-e573-4523-9677-754c6d5867c8 req-f641c829-98ab-4afb-b65a-1c366f5a7688 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:58.237741 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.compute.server_external_events [req-8304e214-e573-4523-9677-754c6d5867c8 req-f641c829-98ab-4afb-b65a-1c366f5a7688 service nova] Creating event network-changed:82b5d66c-2905-491d-8557-b611c573deda for instance 6d80056a-5ade-4f3b-8e08-adf707c34cfe on hv-cinder-85199 Aug 06 14:36:58.242972 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [req-8304e214-e573-4523-9677-754c6d5867c8 req-f641c829-98ab-4afb-b65a-1c366f5a7688 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034537 Aug 06 14:36:58.243563 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 440/833] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:36:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:36:58.349220 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-18787bf2-afb7-4d71-af4a-ff324ba4b664 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:58.349924 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-18787bf2-afb7-4d71-af4a-ff324ba4b664 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:58.352121 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_cell0:SELECT=4 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:36:58.358552 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-18787bf2-afb7-4d71-af4a-ff324ba4b664 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:58.359170 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-18787bf2-afb7-4d71-af4a-ff324ba4b664 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:58.359603 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-18787bf2-afb7-4d71-af4a-ff324ba4b664 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:58.360309 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-18787bf2-afb7-4d71-af4a-ff324ba4b664 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:58.360757 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-18787bf2-afb7-4d71-af4a-ff324ba4b664 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:58.361175 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-18787bf2-afb7-4d71-af4a-ff324ba4b664 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:58.498422 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-18787bf2-afb7-4d71-af4a-ff324ba4b664 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:58.506538 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-18787bf2-afb7-4d71-af4a-ff324ba4b664 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:58.508227 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-18787bf2-afb7-4d71-af4a-ff324ba4b664 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:58.509372 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-18787bf2-afb7-4d71-af4a-ff324ba4b664 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e" status: 200 len: 1408 microversion: 2.20 time: 0.164070 Aug 06 14:36:58.509937 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 394/834] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:36:58 2022] GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e => generated 1408 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:36:59.533852 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-1e67d3d1-438a-4628-8f29-5a3b4279899c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:59.534550 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-1e67d3d1-438a-4628-8f29-5a3b4279899c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:59.541147 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1e67d3d1-438a-4628-8f29-5a3b4279899c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:59.541627 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1e67d3d1-438a-4628-8f29-5a3b4279899c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:59.542061 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1e67d3d1-438a-4628-8f29-5a3b4279899c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:59.543401 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1e67d3d1-438a-4628-8f29-5a3b4279899c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:59.543861 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1e67d3d1-438a-4628-8f29-5a3b4279899c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:59.544287 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1e67d3d1-438a-4628-8f29-5a3b4279899c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:59.751859 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-1e67d3d1-438a-4628-8f29-5a3b4279899c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:59.759828 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-1e67d3d1-438a-4628-8f29-5a3b4279899c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:59.761315 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-1e67d3d1-438a-4628-8f29-5a3b4279899c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:36:59.762971 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-1e67d3d1-438a-4628-8f29-5a3b4279899c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e" status: 200 len: 1600 microversion: 2.20 time: 0.233988 Aug 06 14:36:59.763525 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 441/835] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:36:59 2022] GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e => generated 1600 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:36:59.785789 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-6a5c8eb2-b678-4965-b573-9cd231361f8a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:36:59.786297 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-6a5c8eb2-b678-4965-b573-9cd231361f8a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:36:59.792531 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6a5c8eb2-b678-4965-b573-9cd231361f8a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:59.793009 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6a5c8eb2-b678-4965-b573-9cd231361f8a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:59.793441 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6a5c8eb2-b678-4965-b573-9cd231361f8a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:59.794133 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6a5c8eb2-b678-4965-b573-9cd231361f8a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:36:59.794585 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6a5c8eb2-b678-4965-b573-9cd231361f8a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:36:59.795045 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6a5c8eb2-b678-4965-b573-9cd231361f8a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:36:59.873422 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-6a5c8eb2-b678-4965-b573-9cd231361f8a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.091497 Aug 06 14:36:59.874151 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 395/836] 10.222.0.17 () {60 vars in 1316 bytes} [Sat Aug 6 14:36:59 2022] GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 14:37:01.020751 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [req-de55596f-51c3-42f7-b547-6e0063c15ddb req-7c745f3e-5336-4a00-b046-87be5e3cf6e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91e50552-3108-4fca-82ca-e299af40061e", "tag": "d910f3cd-711d-43f7-8b9c-b79ca1e620bd"}]} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:37:01.030917 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-de55596f-51c3-42f7-b547-6e0063c15ddb req-7c745f3e-5336-4a00-b046-87be5e3cf6e7 service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:01.031712 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-de55596f-51c3-42f7-b547-6e0063c15ddb req-7c745f3e-5336-4a00-b046-87be5e3cf6e7 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:01.032203 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-de55596f-51c3-42f7-b547-6e0063c15ddb req-7c745f3e-5336-4a00-b046-87be5e3cf6e7 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:01.043410 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.compute.server_external_events [req-de55596f-51c3-42f7-b547-6e0063c15ddb req-7c745f3e-5336-4a00-b046-87be5e3cf6e7 service nova] Creating event network-changed:d910f3cd-711d-43f7-8b9c-b79ca1e620bd for instance 91e50552-3108-4fca-82ca-e299af40061e on hv-cinder-85199 Aug 06 14:37:01.048838 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [req-de55596f-51c3-42f7-b547-6e0063c15ddb req-7c745f3e-5336-4a00-b046-87be5e3cf6e7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031745 Aug 06 14:37:01.049426 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 442/837] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:37:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:37:01.256907 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-5d80f6fd-286e-4407-8bf6-24c4e40bc587 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-342308704"}} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:37:01.257515 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-5d80f6fd-286e-4407-8bf6-24c4e40bc587 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] [instance: cb14f0c5-5a75-4357-b1d3-78a2174cca02] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:37:01.264274 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5d80f6fd-286e-4407-8bf6-24c4e40bc587 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:01.264765 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5d80f6fd-286e-4407-8bf6-24c4e40bc587 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:01.265202 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5d80f6fd-286e-4407-8bf6-24c4e40bc587 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:01.265910 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5d80f6fd-286e-4407-8bf6-24c4e40bc587 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:01.266368 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5d80f6fd-286e-4407-8bf6-24c4e40bc587 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:01.266794 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5d80f6fd-286e-4407-8bf6-24c4e40bc587 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:01.406318 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.network.security_group_api [None req-5d80f6fd-286e-4407-8bf6-24c4e40bc587 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Removing security group ef57304b-bead-42ab-8908-384bea5d764c from port 0bc19d76-ece6-4342-a828-3e88712b2b00 Aug 06 14:37:01.755898 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-5d80f6fd-286e-4407-8bf6-24c4e40bc587 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] 10.222.0.17 "POST /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02/action" status: 202 len: 0 microversion: 2.1 time: 0.608616 Aug 06 14:37:01.756661 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 396/838] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Aug 6 14:37:01 2022] POST /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02/action => generated 0 bytes in 610 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 14:37:02.840127 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-d6d67384-ac78-4cdd-8e01-f9b9b17d3640 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:37:02.842169 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-d6d67384-ac78-4cdd-8e01-f9b9b17d3640 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] [instance: cb14f0c5-5a75-4357-b1d3-78a2174cca02] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:37:02.850466 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d6d67384-ac78-4cdd-8e01-f9b9b17d3640 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:02.850466 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d6d67384-ac78-4cdd-8e01-f9b9b17d3640 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:02.850466 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d6d67384-ac78-4cdd-8e01-f9b9b17d3640 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:02.850466 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d6d67384-ac78-4cdd-8e01-f9b9b17d3640 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:02.850946 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d6d67384-ac78-4cdd-8e01-f9b9b17d3640 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:02.850946 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d6d67384-ac78-4cdd-8e01-f9b9b17d3640 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:02.929879 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.objects.instance [None req-d6d67384-ac78-4cdd-8e01-f9b9b17d3640 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lazy-loading 'services' on Instance uuid cb14f0c5-5a75-4357-b1d3-78a2174cca02 {{(pid=117837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 14:37:03.018355 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-d6d67384-ac78-4cdd-8e01-f9b9b17d3640 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] 10.222.0.17 "DELETE /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02/os-volume_attachments/7e1594bd-5f84-4455-bbe3-a9957550a4e8" status: 202 len: 0 microversion: 2.1 time: 0.182735 Aug 06 14:37:03.019037 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 443/839] 10.222.0.17 () {58 vars in 1416 bytes} [Sat Aug 6 14:37:02 2022] DELETE /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02/os-volume_attachments/7e1594bd-5f84-4455-bbe3-a9957550a4e8 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 14:37:03.028095 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-3bc7e84e-863c-4569-8e69-b55f14872b93 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:37:03.030976 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-3bc7e84e-863c-4569-8e69-b55f14872b93 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] [instance: cb14f0c5-5a75-4357-b1d3-78a2174cca02] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:37:03.037391 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3bc7e84e-863c-4569-8e69-b55f14872b93 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:03.038118 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3bc7e84e-863c-4569-8e69-b55f14872b93 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:03.038617 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3bc7e84e-863c-4569-8e69-b55f14872b93 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:03.039761 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3bc7e84e-863c-4569-8e69-b55f14872b93 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:03.040512 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3bc7e84e-863c-4569-8e69-b55f14872b93 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:03.041032 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3bc7e84e-863c-4569-8e69-b55f14872b93 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:03.076057 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [req-e24f4bd3-5df9-4e26-a19e-bfa538fdc52b req-640bd6b1-8c06-4108-be38-fba97fbf2394 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb14f0c5-5a75-4357-b1d3-78a2174cca02", "tag": "0bc19d76-ece6-4342-a828-3e88712b2b00"}, {"name": "network-changed", "server_uuid": "cb14f0c5-5a75-4357-b1d3-78a2174cca02", "tag": "0bc19d76-ece6-4342-a828-3e88712b2b00"}]} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:37:03.079695 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-3bc7e84e-863c-4569-8e69-b55f14872b93 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] 10.222.0.17 "GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056107 Aug 06 14:37:03.080460 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 397/840] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Aug 6 14:37:03 2022] GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:37:03.087362 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-e24f4bd3-5df9-4e26-a19e-bfa538fdc52b req-640bd6b1-8c06-4108-be38-fba97fbf2394 service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:03.087842 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-e24f4bd3-5df9-4e26-a19e-bfa538fdc52b req-640bd6b1-8c06-4108-be38-fba97fbf2394 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:03.088270 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-e24f4bd3-5df9-4e26-a19e-bfa538fdc52b req-640bd6b1-8c06-4108-be38-fba97fbf2394 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:03.101471 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.compute.server_external_events [req-e24f4bd3-5df9-4e26-a19e-bfa538fdc52b req-640bd6b1-8c06-4108-be38-fba97fbf2394 service nova] Creating event network-changed:0bc19d76-ece6-4342-a828-3e88712b2b00 for instance cb14f0c5-5a75-4357-b1d3-78a2174cca02 on hv-cinder-85199 Aug 06 14:37:03.101931 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.compute.server_external_events [req-e24f4bd3-5df9-4e26-a19e-bfa538fdc52b req-640bd6b1-8c06-4108-be38-fba97fbf2394 service nova] Creating event network-changed:0bc19d76-ece6-4342-a828-3e88712b2b00 for instance cb14f0c5-5a75-4357-b1d3-78a2174cca02 on hv-cinder-85199 Aug 06 14:37:03.107661 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [req-e24f4bd3-5df9-4e26-a19e-bfa538fdc52b req-640bd6b1-8c06-4108-be38-fba97fbf2394 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.046288 Aug 06 14:37:03.108253 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 444/841] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:37:03 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:37:04.094889 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-8ad82efc-ae25-41e1-8883-70e1bce870a0 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:37:04.097158 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-8ad82efc-ae25-41e1-8883-70e1bce870a0 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] [instance: cb14f0c5-5a75-4357-b1d3-78a2174cca02] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:37:04.103437 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8ad82efc-ae25-41e1-8883-70e1bce870a0 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:04.103918 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8ad82efc-ae25-41e1-8883-70e1bce870a0 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:04.104350 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8ad82efc-ae25-41e1-8883-70e1bce870a0 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:04.105041 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8ad82efc-ae25-41e1-8883-70e1bce870a0 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:04.105494 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8ad82efc-ae25-41e1-8883-70e1bce870a0 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:04.106105 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8ad82efc-ae25-41e1-8883-70e1bce870a0 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:04.136983 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-8ad82efc-ae25-41e1-8883-70e1bce870a0 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] 10.222.0.17 "GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047484 Aug 06 14:37:04.137547 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 398/842] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Aug 6 14:37:04 2022] GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:37:05.150394 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-238b33da-fa3d-4121-b9a6-bafa41902805 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:37:05.152785 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-238b33da-fa3d-4121-b9a6-bafa41902805 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] [instance: cb14f0c5-5a75-4357-b1d3-78a2174cca02] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:37:05.159821 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-238b33da-fa3d-4121-b9a6-bafa41902805 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:05.160305 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-238b33da-fa3d-4121-b9a6-bafa41902805 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:05.160730 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-238b33da-fa3d-4121-b9a6-bafa41902805 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:05.161414 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-238b33da-fa3d-4121-b9a6-bafa41902805 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:05.161856 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-238b33da-fa3d-4121-b9a6-bafa41902805 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:05.162269 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-238b33da-fa3d-4121-b9a6-bafa41902805 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:05.165958 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=98 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:37:05.191452 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-238b33da-fa3d-4121-b9a6-bafa41902805 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] 10.222.0.17 "GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046070 Aug 06 14:37:05.192005 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 445/843] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Aug 6 14:37:05 2022] GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 14:37:05.202979 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-b98170a1-9ca6-4c97-b4ff-0a16ac1ed4d0 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:37:05.203472 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-b98170a1-9ca6-4c97-b4ff-0a16ac1ed4d0 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] [instance: cb14f0c5-5a75-4357-b1d3-78a2174cca02] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:37:05.209764 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b98170a1-9ca6-4c97-b4ff-0a16ac1ed4d0 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:05.210244 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b98170a1-9ca6-4c97-b4ff-0a16ac1ed4d0 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:05.210677 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b98170a1-9ca6-4c97-b4ff-0a16ac1ed4d0 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:05.211397 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b98170a1-9ca6-4c97-b4ff-0a16ac1ed4d0 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:05.211851 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b98170a1-9ca6-4c97-b4ff-0a16ac1ed4d0 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:05.212274 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b98170a1-9ca6-4c97-b4ff-0a16ac1ed4d0 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:05.285056 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.wsgi [None req-b98170a1-9ca6-4c97-b4ff-0a16ac1ed4d0 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] HTTP exception thrown: Instance cb14f0c5-5a75-4357-b1d3-78a2174cca02 is not attached to volume 7e1594bd-5f84-4455-bbe3-a9957550a4e8 Aug 06 14:37:05.287769 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-b98170a1-9ca6-4c97-b4ff-0a16ac1ed4d0 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Request method failure captured: Aug 06 14:37:05.287769 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: request: DELETE /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02/os-volume_attachments/7e1594bd-5f84-4455-bbe3-a9957550a4e8 HTTP/1.1 Aug 06 14:37:05.287769 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Accept: application/json Aug 06 14:37:05.287769 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Accept-Encoding: identity Aug 06 14:37:05.287769 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Connection: close Aug 06 14:37:05.287769 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Content-Length: 0 Aug 06 14:37:05.287769 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Content-Type: application/json Aug 06 14:37:05.287769 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Host: 10.222.0.17 Aug 06 14:37:05.287769 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Openstack-System-Scope: None Aug 06 14:37:05.287769 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: User-Agent: python-urllib3/1.26.11 Aug 06 14:37:05.287769 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Auth-Token: gAAAAABi7ntDBaXVT_AtlCe3n2YtSeiU_chlXjocoXiTeZhVUcyrN3klF-53ixFwCxdlB5rlUXV4BeB8_2icSTesERU5vX0S357WWaiQrdz7K1UoUvqMwh1I2D0fQEZeUOabhK58cgFIYIZBro-IN9dolHyL9uaLvNJzfOr-gJXRNkw9-QYUsbk Aug 06 14:37:05.287769 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Domain-Id: None Aug 06 14:37:05.287769 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Domain-Name: None Aug 06 14:37:05.287769 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Identity-Status: Confirmed Aug 06 14:37:05.287769 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Is-Admin-Project: True Aug 06 14:37:05.287769 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Domain-Id: default Aug 06 14:37:05.287769 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Domain-Name: Default Aug 06 14:37:05.287769 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Id: ca1a30d14e9a4c0ebd2fd8549a09ee44 Aug 06 14:37:05.287769 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Name: tempest-TestMinimumBasicScenario-764311940 Aug 06 14:37:05.287769 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Role: member,reader Aug 06 14:37:05.287769 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Roles: member,reader Aug 06 14:37:05.289426 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ca1a30d14e9a4c0ebd2fd8549a09ee44"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ca1a30d14e9a4c0ebd2fd8549a09ee44"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ca1a30d14e9a4c0ebd2fd8549a09ee44", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ca1a30d14e9a4c0ebd2fd8549a09ee44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 06 14:37:05.289426 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Tenant: tempest-TestMinimumBasicScenario-764311940 Aug 06 14:37:05.289426 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Tenant-Id: ca1a30d14e9a4c0ebd2fd8549a09ee44 Aug 06 14:37:05.289426 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Tenant-Name: tempest-TestMinimumBasicScenario-764311940 Aug 06 14:37:05.289426 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User: tempest-TestMinimumBasicScenario-764311940-project Aug 06 14:37:05.289426 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Domain-Id: default Aug 06 14:37:05.289426 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Domain-Name: Default Aug 06 14:37:05.289426 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Id: f96728f2ae5d4885858560396971a1b4 Aug 06 14:37:05.289426 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Name: tempest-TestMinimumBasicScenario-764311940-project Aug 06 14:37:05.289426 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: method: > Aug 06 14:37:05.289426 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: exception: Instance cb14f0c5-5a75-4357-b1d3-78a2174cca02 is not attached to volume 7e1594bd-5f84-4455-bbe3-a9957550a4e8 Aug 06 14:37:05.290257 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: action_args: {'server_id': 'cb14f0c5-5a75-4357-b1d3-78a2174cca02', 'id': '7e1594bd-5f84-4455-bbe3-a9957550a4e8'} Aug 06 14:37:05.290257 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 14:37:05.290257 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:37:05.290257 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 06 14:37:05.290257 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 06 14:37:05.290257 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 06 14:37:05.290257 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 06 14:37:05.290257 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 06 14:37:05.290257 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 06 14:37:05.290257 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 7e1594bd-5f84-4455-bbe3-a9957550a4e8. Aug 06 14:37:05.290257 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:37:05.290257 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:37:05.290257 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:37:05.290257 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:37:05.290257 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:37:05.290257 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:37:05.290257 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 14:37:05.290257 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 14:37:05.290257 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 14:37:05.291594 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 14:37:05.291594 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 06 14:37:05.291594 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 06 14:37:05.291594 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb14f0c5-5a75-4357-b1d3-78a2174cca02 is not attached to volume 7e1594bd-5f84-4455-bbe3-a9957550a4e8 Aug 06 14:37:05.291594 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:37:05.291594 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:37:05.291594 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:37:05.291594 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:37:05.291594 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:37:05.291594 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:37:05.291594 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 14:37:05.291594 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 14:37:05.291594 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb14f0c5-5a75-4357-b1d3-78a2174cca02 is not attached to volume 7e1594bd-5f84-4455-bbe3-a9957550a4e8 Aug 06 14:37:05.291594 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:37:05.291594 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-b98170a1-9ca6-4c97-b4ff-0a16ac1ed4d0 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Returning 404 to user: Instance cb14f0c5-5a75-4357-b1d3-78a2174cca02 is not attached to volume 7e1594bd-5f84-4455-bbe3-a9957550a4e8 {{(pid=117838) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 14:37:05.292563 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-b98170a1-9ca6-4c97-b4ff-0a16ac1ed4d0 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] 10.222.0.17 "DELETE /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02/os-volume_attachments/7e1594bd-5f84-4455-bbe3-a9957550a4e8" status: 404 len: 154 microversion: 2.1 time: 0.090789 Aug 06 14:37:05.292563 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 399/844] 10.222.0.17 () {58 vars in 1416 bytes} [Sat Aug 6 14:37:05 2022] DELETE /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02/os-volume_attachments/7e1594bd-5f84-4455-bbe3-a9957550a4e8 => generated 154 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 14:37:06.424723 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-cdb4ad0c-6f53-4ad8-b461-d91029323730 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:37:06.425225 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-cdb4ad0c-6f53-4ad8-b461-d91029323730 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] [instance: cb14f0c5-5a75-4357-b1d3-78a2174cca02] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:37:06.431520 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-cdb4ad0c-6f53-4ad8-b461-d91029323730 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:06.432258 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-cdb4ad0c-6f53-4ad8-b461-d91029323730 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:06.432690 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-cdb4ad0c-6f53-4ad8-b461-d91029323730 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:06.433371 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-cdb4ad0c-6f53-4ad8-b461-d91029323730 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:06.433824 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-cdb4ad0c-6f53-4ad8-b461-d91029323730 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:06.434245 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-cdb4ad0c-6f53-4ad8-b461-d91029323730 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:06.457986 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-cdb4ad0c-6f53-4ad8-b461-d91029323730 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] [instance: cb14f0c5-5a75-4357-b1d3-78a2174cca02] Going to try to terminate instance {{(pid=117837) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 14:37:06.529337 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-cdb4ad0c-6f53-4ad8-b461-d91029323730 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] 10.222.0.17 "DELETE /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02" status: 204 len: 0 microversion: 2.1 time: 0.107572 Aug 06 14:37:06.530123 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 446/845] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Aug 6 14:37:06 2022] DELETE /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 14:37:06.539282 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-7fc15128-9c68-4ab3-bb4b-1d837852881f tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:37:06.539904 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-7fc15128-9c68-4ab3-bb4b-1d837852881f tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] [instance: cb14f0c5-5a75-4357-b1d3-78a2174cca02] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:37:06.547503 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7fc15128-9c68-4ab3-bb4b-1d837852881f tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:06.547983 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7fc15128-9c68-4ab3-bb4b-1d837852881f tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:06.548416 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7fc15128-9c68-4ab3-bb4b-1d837852881f tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:06.549110 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7fc15128-9c68-4ab3-bb4b-1d837852881f tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:06.549563 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7fc15128-9c68-4ab3-bb4b-1d837852881f tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:06.549984 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7fc15128-9c68-4ab3-bb4b-1d837852881f tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:06.682090 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-7fc15128-9c68-4ab3-bb4b-1d837852881f tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96728f2ae5d4885858560396971a1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a30d14e9a4c0ebd2fd8549a09ee44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:37:06.690711 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-7fc15128-9c68-4ab3-bb4b-1d837852881f tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] 10.222.0.17 "GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02" status: 200 len: 1555 microversion: 2.1 time: 0.156124 Aug 06 14:37:06.691295 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 400/846] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:37:06 2022] GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02 => generated 1555 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:37:07.712916 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-0223966b-d4f1-49ad-878d-b55923bced8a tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:37:07.713618 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-0223966b-d4f1-49ad-878d-b55923bced8a tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] [instance: cb14f0c5-5a75-4357-b1d3-78a2174cca02] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:37:07.720000 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0223966b-d4f1-49ad-878d-b55923bced8a tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:07.720485 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0223966b-d4f1-49ad-878d-b55923bced8a tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:07.720921 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0223966b-d4f1-49ad-878d-b55923bced8a tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:07.721611 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0223966b-d4f1-49ad-878d-b55923bced8a tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:07.722064 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0223966b-d4f1-49ad-878d-b55923bced8a tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:07.722490 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0223966b-d4f1-49ad-878d-b55923bced8a tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:07.853294 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-0223966b-d4f1-49ad-878d-b55923bced8a tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96728f2ae5d4885858560396971a1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a30d14e9a4c0ebd2fd8549a09ee44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:37:07.861241 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-0223966b-d4f1-49ad-878d-b55923bced8a tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] 10.222.0.17 "GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02" status: 200 len: 1555 microversion: 2.1 time: 0.152572 Aug 06 14:37:07.861796 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 447/847] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:37:07 2022] GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02 => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:37:08.882657 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-12cf37fd-e55d-4809-9e93-7aa5b476f749 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:37:08.883285 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-12cf37fd-e55d-4809-9e93-7aa5b476f749 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] [instance: cb14f0c5-5a75-4357-b1d3-78a2174cca02] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:37:08.890224 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-12cf37fd-e55d-4809-9e93-7aa5b476f749 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:08.890697 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-12cf37fd-e55d-4809-9e93-7aa5b476f749 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:08.891323 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-12cf37fd-e55d-4809-9e93-7aa5b476f749 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:08.892627 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-12cf37fd-e55d-4809-9e93-7aa5b476f749 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:08.893462 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-12cf37fd-e55d-4809-9e93-7aa5b476f749 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:08.893936 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-12cf37fd-e55d-4809-9e93-7aa5b476f749 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:09.023745 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-12cf37fd-e55d-4809-9e93-7aa5b476f749 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96728f2ae5d4885858560396971a1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca1a30d14e9a4c0ebd2fd8549a09ee44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:37:09.031522 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-12cf37fd-e55d-4809-9e93-7aa5b476f749 tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] 10.222.0.17 "GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02" status: 200 len: 1555 microversion: 2.1 time: 0.152678 Aug 06 14:37:09.032089 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 401/848] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:37:08 2022] GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02 => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:37:09.357567 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [req-93e23111-8cd1-44ab-9626-2fa79761c742 req-9e8b7e20-03a8-4bab-95d6-ed03c8141031 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb14f0c5-5a75-4357-b1d3-78a2174cca02", "name": "network-vif-deleted", "tag": "0bc19d76-ece6-4342-a828-3e88712b2b00"}]} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:37:09.367477 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-93e23111-8cd1-44ab-9626-2fa79761c742 req-9e8b7e20-03a8-4bab-95d6-ed03c8141031 service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:09.367879 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-93e23111-8cd1-44ab-9626-2fa79761c742 req-9e8b7e20-03a8-4bab-95d6-ed03c8141031 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:09.368306 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-93e23111-8cd1-44ab-9626-2fa79761c742 req-9e8b7e20-03a8-4bab-95d6-ed03c8141031 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:09.380119 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.compute.server_external_events [req-93e23111-8cd1-44ab-9626-2fa79761c742 req-9e8b7e20-03a8-4bab-95d6-ed03c8141031 service nova] Creating event network-vif-deleted:0bc19d76-ece6-4342-a828-3e88712b2b00 for instance cb14f0c5-5a75-4357-b1d3-78a2174cca02 on hv-cinder-85199 Aug 06 14:37:09.384810 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [req-93e23111-8cd1-44ab-9626-2fa79761c742 req-9e8b7e20-03a8-4bab-95d6-ed03c8141031 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031525 Aug 06 14:37:09.385462 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 448/849] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:37:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:37:10.052287 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-7586f317-c8bd-468e-aaec-5d7e491a639c tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:37:10.052928 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-7586f317-c8bd-468e-aaec-5d7e491a639c tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] [instance: cb14f0c5-5a75-4357-b1d3-78a2174cca02] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:37:10.059550 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7586f317-c8bd-468e-aaec-5d7e491a639c tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:10.060037 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7586f317-c8bd-468e-aaec-5d7e491a639c tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:10.060475 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7586f317-c8bd-468e-aaec-5d7e491a639c tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:10.061163 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7586f317-c8bd-468e-aaec-5d7e491a639c tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:10.061621 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7586f317-c8bd-468e-aaec-5d7e491a639c tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:10.062047 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7586f317-c8bd-468e-aaec-5d7e491a639c tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:10.075264 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.wsgi [None req-7586f317-c8bd-468e-aaec-5d7e491a639c tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] HTTP exception thrown: Instance cb14f0c5-5a75-4357-b1d3-78a2174cca02 could not be found. Aug 06 14:37:10.076763 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-7586f317-c8bd-468e-aaec-5d7e491a639c tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Request method failure captured: Aug 06 14:37:10.076763 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: request: GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02 HTTP/1.1 Aug 06 14:37:10.076763 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Accept: application/json Aug 06 14:37:10.076763 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Accept-Encoding: identity Aug 06 14:37:10.076763 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Connection: close Aug 06 14:37:10.076763 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Content-Length: 0 Aug 06 14:37:10.076763 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Content-Type: application/json Aug 06 14:37:10.076763 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Host: 10.222.0.17 Aug 06 14:37:10.076763 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Openstack-System-Scope: None Aug 06 14:37:10.076763 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: User-Agent: python-urllib3/1.26.11 Aug 06 14:37:10.076763 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Auth-Token: gAAAAABi7ntDBaXVT_AtlCe3n2YtSeiU_chlXjocoXiTeZhVUcyrN3klF-53ixFwCxdlB5rlUXV4BeB8_2icSTesERU5vX0S357WWaiQrdz7K1UoUvqMwh1I2D0fQEZeUOabhK58cgFIYIZBro-IN9dolHyL9uaLvNJzfOr-gJXRNkw9-QYUsbk Aug 06 14:37:10.076763 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Domain-Id: None Aug 06 14:37:10.076763 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Domain-Name: None Aug 06 14:37:10.076763 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Identity-Status: Confirmed Aug 06 14:37:10.076763 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Is-Admin-Project: True Aug 06 14:37:10.076763 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Domain-Id: default Aug 06 14:37:10.076763 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Domain-Name: Default Aug 06 14:37:10.076763 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Id: ca1a30d14e9a4c0ebd2fd8549a09ee44 Aug 06 14:37:10.076763 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Name: tempest-TestMinimumBasicScenario-764311940 Aug 06 14:37:10.076763 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Role: member,reader Aug 06 14:37:10.076763 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Roles: member,reader Aug 06 14:37:10.078314 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ca1a30d14e9a4c0ebd2fd8549a09ee44"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/ca1a30d14e9a4c0ebd2fd8549a09ee44"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_ca1a30d14e9a4c0ebd2fd8549a09ee44", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/ca1a30d14e9a4c0ebd2fd8549a09ee44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 06 14:37:10.078314 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Tenant: tempest-TestMinimumBasicScenario-764311940 Aug 06 14:37:10.078314 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Tenant-Id: ca1a30d14e9a4c0ebd2fd8549a09ee44 Aug 06 14:37:10.078314 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Tenant-Name: tempest-TestMinimumBasicScenario-764311940 Aug 06 14:37:10.078314 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User: tempest-TestMinimumBasicScenario-764311940-project Aug 06 14:37:10.078314 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Domain-Id: default Aug 06 14:37:10.078314 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Domain-Name: Default Aug 06 14:37:10.078314 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Id: f96728f2ae5d4885858560396971a1b4 Aug 06 14:37:10.078314 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Name: tempest-TestMinimumBasicScenario-764311940-project Aug 06 14:37:10.078314 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: method: > Aug 06 14:37:10.078314 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: exception: Instance cb14f0c5-5a75-4357-b1d3-78a2174cca02 could not be found. Aug 06 14:37:10.078314 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: action_args: {'id': 'cb14f0c5-5a75-4357-b1d3-78a2174cca02'} Aug 06 14:37:10.079219 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 14:37:10.079219 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:37:10.079219 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 14:37:10.079219 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 14:37:10.079219 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 14:37:10.079219 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 14:37:10.079219 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 14:37:10.079219 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 14:37:10.079219 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 14:37:10.079219 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 14:37:10.079219 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb14f0c5-5a75-4357-b1d3-78a2174cca02 could not be found. Aug 06 14:37:10.079219 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:37:10.079219 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:37:10.079219 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:37:10.079219 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:37:10.079219 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:37:10.079219 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:37:10.079219 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 14:37:10.079219 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 14:37:10.079219 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 14:37:10.080692 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 14:37:10.080692 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 14:37:10.080692 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 14:37:10.080692 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 14:37:10.080692 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 14:37:10.080692 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 14:37:10.080692 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 14:37:10.080692 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb14f0c5-5a75-4357-b1d3-78a2174cca02 could not be found. Aug 06 14:37:10.080692 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:37:10.080692 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:37:10.080692 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:37:10.080692 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:37:10.080692 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:37:10.080692 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:37:10.080692 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 14:37:10.080692 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 14:37:10.080692 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb14f0c5-5a75-4357-b1d3-78a2174cca02 could not be found. Aug 06 14:37:10.080692 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:37:10.082217 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-7586f317-c8bd-468e-aaec-5d7e491a639c tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Returning 404 to user: Instance cb14f0c5-5a75-4357-b1d3-78a2174cca02 could not be found. {{(pid=117838) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 14:37:10.082217 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-7586f317-c8bd-468e-aaec-5d7e491a639c tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] 10.222.0.17 "GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02" status: 404 len: 111 microversion: 2.1 time: 0.029774 Aug 06 14:37:10.082217 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 402/850] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:37:10 2022] GET /compute/v2.1/servers/cb14f0c5-5a75-4357-b1d3-78a2174cca02 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 14:37:10.087545 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-f11e3494-15c4-4865-86a3-e1b4187ee07d tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] Calling method '.version_select at 0x7fbab0cec160>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:37:10.105819 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-f11e3494-15c4-4865-86a3-e1b4187ee07d tempest-TestMinimumBasicScenario-764311940 tempest-TestMinimumBasicScenario-764311940-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1034926031" status: 202 len: 0 microversion: 2.1 time: 0.022501 Aug 06 14:37:10.107018 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 449/851] 10.222.0.17 () {58 vars in 1272 bytes} [Sat Aug 6 14:37:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1034926031 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 14:37:37.440451 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-6066e004-5336-47e3-915a-5b30b512097f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:37:37.440987 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-6066e004-5336-47e3-915a-5b30b512097f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 8805d1fa-6d65-45c7-ae75-17e46feccccb] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:37:37.443001 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_api:SELECT=61 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:37:37.443657 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_cell1:SELECT=97 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:37:37.449262 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6066e004-5336-47e3-915a-5b30b512097f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:37.449734 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6066e004-5336-47e3-915a-5b30b512097f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:37.450159 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6066e004-5336-47e3-915a-5b30b512097f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:37.451511 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6066e004-5336-47e3-915a-5b30b512097f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:37.451968 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6066e004-5336-47e3-915a-5b30b512097f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:37.452386 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6066e004-5336-47e3-915a-5b30b512097f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:37.531865 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.objects.instance [None req-6066e004-5336-47e3-915a-5b30b512097f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lazy-loading 'services' on Instance uuid 8805d1fa-6d65-45c7-ae75-17e46feccccb {{(pid=117838) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 14:37:37.617396 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-6066e004-5336-47e3-915a-5b30b512097f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "DELETE /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb/os-volume_attachments/e5569621-03ca-4d10-9cd6-fc59ef122000" status: 202 len: 0 microversion: 2.1 time: 0.180987 Aug 06 14:37:37.617986 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 403/852] 10.222.0.17 () {58 vars in 1416 bytes} [Sat Aug 6 14:37:37 2022] DELETE /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb/os-volume_attachments/e5569621-03ca-4d10-9cd6-fc59ef122000 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 14:37:37.624295 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:37:37.625016 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=7,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:37:37.629114 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-501c8421-7356-4b8d-9e5f-97bce8cd37b7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:37:37.631684 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-501c8421-7356-4b8d-9e5f-97bce8cd37b7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 8805d1fa-6d65-45c7-ae75-17e46feccccb] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:37:37.640357 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-501c8421-7356-4b8d-9e5f-97bce8cd37b7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:37.640860 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-501c8421-7356-4b8d-9e5f-97bce8cd37b7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:37.641319 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-501c8421-7356-4b8d-9e5f-97bce8cd37b7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:37.642017 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-501c8421-7356-4b8d-9e5f-97bce8cd37b7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:37.642463 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-501c8421-7356-4b8d-9e5f-97bce8cd37b7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:37.642905 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-501c8421-7356-4b8d-9e5f-97bce8cd37b7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:37.673362 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-501c8421-7356-4b8d-9e5f-97bce8cd37b7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051026 Aug 06 14:37:37.673999 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 450/853] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Aug 6 14:37:37 2022] GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:37:38.687489 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-68776f82-c529-418f-bb7a-a45bf7cbc960 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:37:38.689763 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-68776f82-c529-418f-bb7a-a45bf7cbc960 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 8805d1fa-6d65-45c7-ae75-17e46feccccb] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:37:38.695867 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-68776f82-c529-418f-bb7a-a45bf7cbc960 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:38.696371 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-68776f82-c529-418f-bb7a-a45bf7cbc960 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:38.696783 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-68776f82-c529-418f-bb7a-a45bf7cbc960 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:38.697461 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-68776f82-c529-418f-bb7a-a45bf7cbc960 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:38.697910 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-68776f82-c529-418f-bb7a-a45bf7cbc960 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:38.698328 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-68776f82-c529-418f-bb7a-a45bf7cbc960 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:38.878626 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-68776f82-c529-418f-bb7a-a45bf7cbc960 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.196369 Aug 06 14:37:38.879131 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 404/854] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Aug 6 14:37:38 2022] GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb/os-volume_attachments => generated 25 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 14:37:38.956662 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-d680f09d-9d60-4ddc-b0b9-dcd951677355 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:37:38.957191 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-d680f09d-9d60-4ddc-b0b9-dcd951677355 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 8805d1fa-6d65-45c7-ae75-17e46feccccb] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:37:38.963931 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d680f09d-9d60-4ddc-b0b9-dcd951677355 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:38.964435 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d680f09d-9d60-4ddc-b0b9-dcd951677355 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:38.964917 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d680f09d-9d60-4ddc-b0b9-dcd951677355 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:38.965588 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d680f09d-9d60-4ddc-b0b9-dcd951677355 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:38.966040 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d680f09d-9d60-4ddc-b0b9-dcd951677355 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:38.966464 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d680f09d-9d60-4ddc-b0b9-dcd951677355 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:38.990387 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-d680f09d-9d60-4ddc-b0b9-dcd951677355 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 8805d1fa-6d65-45c7-ae75-17e46feccccb] Going to try to terminate instance {{(pid=117837) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 14:37:39.063422 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-d680f09d-9d60-4ddc-b0b9-dcd951677355 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "DELETE /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb" status: 204 len: 0 microversion: 2.1 time: 0.110051 Aug 06 14:37:39.064204 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 451/855] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Aug 6 14:37:38 2022] DELETE /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 14:37:39.072953 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-43b87877-3502-4f74-8435-2a330b846c80 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:37:39.073588 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-43b87877-3502-4f74-8435-2a330b846c80 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 8805d1fa-6d65-45c7-ae75-17e46feccccb] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:37:39.080187 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-43b87877-3502-4f74-8435-2a330b846c80 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:39.080664 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-43b87877-3502-4f74-8435-2a330b846c80 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:39.081095 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-43b87877-3502-4f74-8435-2a330b846c80 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:39.081778 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-43b87877-3502-4f74-8435-2a330b846c80 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:39.082231 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-43b87877-3502-4f74-8435-2a330b846c80 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:39.082651 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-43b87877-3502-4f74-8435-2a330b846c80 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:39.212736 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-43b87877-3502-4f74-8435-2a330b846c80 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:37:39.220279 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-43b87877-3502-4f74-8435-2a330b846c80 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb" status: 200 len: 1688 microversion: 2.1 time: 0.151349 Aug 06 14:37:39.220832 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 405/856] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:37:39 2022] GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb => generated 1688 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:37:40.241648 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-2cb8d328-f9bd-4997-8b92-4bf65e3ba618 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:37:40.242353 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-2cb8d328-f9bd-4997-8b92-4bf65e3ba618 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 8805d1fa-6d65-45c7-ae75-17e46feccccb] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:37:40.248577 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2cb8d328-f9bd-4997-8b92-4bf65e3ba618 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:40.249062 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2cb8d328-f9bd-4997-8b92-4bf65e3ba618 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:40.249488 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2cb8d328-f9bd-4997-8b92-4bf65e3ba618 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:40.250165 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2cb8d328-f9bd-4997-8b92-4bf65e3ba618 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:40.250619 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2cb8d328-f9bd-4997-8b92-4bf65e3ba618 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:40.251081 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2cb8d328-f9bd-4997-8b92-4bf65e3ba618 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:40.384308 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-2cb8d328-f9bd-4997-8b92-4bf65e3ba618 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:37:40.392231 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-2cb8d328-f9bd-4997-8b92-4bf65e3ba618 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb" status: 200 len: 1688 microversion: 2.1 time: 0.154757 Aug 06 14:37:40.392763 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 452/857] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:37:40 2022] GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb => generated 1688 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:37:40.835142 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-4373294a-76a9-4863-be90-cb08606a65c0 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:37:40.837450 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-4373294a-76a9-4863-be90-cb08606a65c0 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:37:40.843914 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4373294a-76a9-4863-be90-cb08606a65c0 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:40.844389 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4373294a-76a9-4863-be90-cb08606a65c0 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:40.844812 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4373294a-76a9-4863-be90-cb08606a65c0 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:40.845496 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4373294a-76a9-4863-be90-cb08606a65c0 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:40.845944 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4373294a-76a9-4863-be90-cb08606a65c0 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:40.846357 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4373294a-76a9-4863-be90-cb08606a65c0 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:40.875716 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-4373294a-76a9-4863-be90-cb08606a65c0 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044475 Aug 06 14:37:40.876249 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 406/858] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Aug 6 14:37:40 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 14:37:40.936116 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-81e57912-6574-437d-9006-b1dc551c5635 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:37:40.936610 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-81e57912-6574-437d-9006-b1dc551c5635 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:37:40.942370 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-81e57912-6574-437d-9006-b1dc551c5635 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:40.942841 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-81e57912-6574-437d-9006-b1dc551c5635 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:40.943301 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-81e57912-6574-437d-9006-b1dc551c5635 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:40.943973 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-81e57912-6574-437d-9006-b1dc551c5635 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:40.944422 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-81e57912-6574-437d-9006-b1dc551c5635 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:40.944839 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-81e57912-6574-437d-9006-b1dc551c5635 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:40.968038 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-81e57912-6574-437d-9006-b1dc551c5635 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Going to try to terminate instance {{(pid=117837) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 14:37:41.039844 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-81e57912-6574-437d-9006-b1dc551c5635 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "DELETE /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 204 len: 0 microversion: 2.1 time: 0.108101 Aug 06 14:37:41.040348 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 453/859] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Aug 6 14:37:40 2022] DELETE /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 14:37:41.048911 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-55d81ec8-f0e3-407a-8485-8f35b331e288 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:37:41.049523 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-55d81ec8-f0e3-407a-8485-8f35b331e288 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:37:41.055447 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-55d81ec8-f0e3-407a-8485-8f35b331e288 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:41.055923 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-55d81ec8-f0e3-407a-8485-8f35b331e288 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:41.056354 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-55d81ec8-f0e3-407a-8485-8f35b331e288 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:41.057297 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-55d81ec8-f0e3-407a-8485-8f35b331e288 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:41.057751 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-55d81ec8-f0e3-407a-8485-8f35b331e288 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:41.058170 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-55d81ec8-f0e3-407a-8485-8f35b331e288 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:41.192993 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-55d81ec8-f0e3-407a-8485-8f35b331e288 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:37:41.200421 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-55d81ec8-f0e3-407a-8485-8f35b331e288 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1672 microversion: 2.1 time: 0.155879 Aug 06 14:37:41.200978 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 407/860] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:37:41 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1672 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:37:41.413593 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-1ef96baf-4d1b-4ec4-bc3f-072ace384f43 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:37:41.414317 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-1ef96baf-4d1b-4ec4-bc3f-072ace384f43 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 8805d1fa-6d65-45c7-ae75-17e46feccccb] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:37:41.421689 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1ef96baf-4d1b-4ec4-bc3f-072ace384f43 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:41.422412 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1ef96baf-4d1b-4ec4-bc3f-072ace384f43 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:41.422848 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1ef96baf-4d1b-4ec4-bc3f-072ace384f43 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:41.423548 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1ef96baf-4d1b-4ec4-bc3f-072ace384f43 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:41.423996 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1ef96baf-4d1b-4ec4-bc3f-072ace384f43 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:41.424413 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1ef96baf-4d1b-4ec4-bc3f-072ace384f43 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:41.550580 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-1ef96baf-4d1b-4ec4-bc3f-072ace384f43 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:37:41.558656 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-1ef96baf-4d1b-4ec4-bc3f-072ace384f43 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb" status: 200 len: 1688 microversion: 2.1 time: 0.149231 Aug 06 14:37:41.559597 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 454/861] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:37:41 2022] GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb => generated 1688 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:37:42.221549 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-41a11d48-98a8-4a61-9d6d-7a77ce101669 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:37:42.222188 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-41a11d48-98a8-4a61-9d6d-7a77ce101669 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:37:42.228230 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-41a11d48-98a8-4a61-9d6d-7a77ce101669 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:42.228714 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-41a11d48-98a8-4a61-9d6d-7a77ce101669 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:42.229148 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-41a11d48-98a8-4a61-9d6d-7a77ce101669 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:42.229830 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-41a11d48-98a8-4a61-9d6d-7a77ce101669 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:42.230282 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-41a11d48-98a8-4a61-9d6d-7a77ce101669 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:42.230706 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-41a11d48-98a8-4a61-9d6d-7a77ce101669 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:42.354902 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-41a11d48-98a8-4a61-9d6d-7a77ce101669 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:37:42.362654 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-41a11d48-98a8-4a61-9d6d-7a77ce101669 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1672 microversion: 2.1 time: 0.144991 Aug 06 14:37:42.363238 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 408/862] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:37:42 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1672 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:37:42.579457 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-624257d8-aabc-4bf7-b50e-fc0c4cd90ef1 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:37:42.579992 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-624257d8-aabc-4bf7-b50e-fc0c4cd90ef1 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 8805d1fa-6d65-45c7-ae75-17e46feccccb] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:37:42.586379 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-624257d8-aabc-4bf7-b50e-fc0c4cd90ef1 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:42.586839 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-624257d8-aabc-4bf7-b50e-fc0c4cd90ef1 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:42.587291 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-624257d8-aabc-4bf7-b50e-fc0c4cd90ef1 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:42.587963 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-624257d8-aabc-4bf7-b50e-fc0c4cd90ef1 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:42.588406 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-624257d8-aabc-4bf7-b50e-fc0c4cd90ef1 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:42.588821 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-624257d8-aabc-4bf7-b50e-fc0c4cd90ef1 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:42.717980 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-624257d8-aabc-4bf7-b50e-fc0c4cd90ef1 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:37:42.725324 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-624257d8-aabc-4bf7-b50e-fc0c4cd90ef1 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb" status: 200 len: 1688 microversion: 2.1 time: 0.149743 Aug 06 14:37:42.725873 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 455/863] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:37:42 2022] GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb => generated 1688 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:37:43.384467 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-c587f21f-9d33-4045-815f-ffa8f20ebc7f tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:37:43.385374 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-c587f21f-9d33-4045-815f-ffa8f20ebc7f tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:37:43.392323 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c587f21f-9d33-4045-815f-ffa8f20ebc7f tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:43.392885 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c587f21f-9d33-4045-815f-ffa8f20ebc7f tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:43.393387 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c587f21f-9d33-4045-815f-ffa8f20ebc7f tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:43.394150 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c587f21f-9d33-4045-815f-ffa8f20ebc7f tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:43.394670 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c587f21f-9d33-4045-815f-ffa8f20ebc7f tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:43.395316 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c587f21f-9d33-4045-815f-ffa8f20ebc7f tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:43.746080 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-dc65ca66-4272-450c-a3d4-19d78c7c2125 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:37:43.746623 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-dc65ca66-4272-450c-a3d4-19d78c7c2125 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 8805d1fa-6d65-45c7-ae75-17e46feccccb] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:37:43.753937 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-dc65ca66-4272-450c-a3d4-19d78c7c2125 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:43.754508 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-dc65ca66-4272-450c-a3d4-19d78c7c2125 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:43.755063 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-dc65ca66-4272-450c-a3d4-19d78c7c2125 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:43.755846 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-dc65ca66-4272-450c-a3d4-19d78c7c2125 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:43.756368 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-dc65ca66-4272-450c-a3d4-19d78c7c2125 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:43.757051 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-dc65ca66-4272-450c-a3d4-19d78c7c2125 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:43.860298 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-dc65ca66-4272-450c-a3d4-19d78c7c2125 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:37:43.872304 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-dc65ca66-4272-450c-a3d4-19d78c7c2125 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb" status: 200 len: 1620 microversion: 2.1 time: 0.128207 Aug 06 14:37:43.872909 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 456/864] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:37:43 2022] GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb => generated 1620 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:37:43.895313 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-c587f21f-9d33-4045-815f-ffa8f20ebc7f tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:37:43.903289 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-c587f21f-9d33-4045-815f-ffa8f20ebc7f tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1672 microversion: 2.1 time: 0.522671 Aug 06 14:37:43.903844 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 409/865] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:37:43 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1672 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:37:43.986248 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [req-7b6db4b8-1d65-4c06-a10d-618c09d92afa req-2770c6e4-3b32-4c92-8bba-fde8f9ab48fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8805d1fa-6d65-45c7-ae75-17e46feccccb", "name": "network-vif-deleted", "tag": "6b7de55b-a834-4f94-92da-b46aaa6033a5"}]} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:37:44.008323 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-7b6db4b8-1d65-4c06-a10d-618c09d92afa req-2770c6e4-3b32-4c92-8bba-fde8f9ab48fc service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:44.009130 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-7b6db4b8-1d65-4c06-a10d-618c09d92afa req-2770c6e4-3b32-4c92-8bba-fde8f9ab48fc service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:44.009707 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-7b6db4b8-1d65-4c06-a10d-618c09d92afa req-2770c6e4-3b32-4c92-8bba-fde8f9ab48fc service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:44.039544 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.compute.server_external_events [req-7b6db4b8-1d65-4c06-a10d-618c09d92afa req-2770c6e4-3b32-4c92-8bba-fde8f9ab48fc service nova] Creating event network-vif-deleted:6b7de55b-a834-4f94-92da-b46aaa6033a5 for instance 8805d1fa-6d65-45c7-ae75-17e46feccccb on hv-cinder-85199 Aug 06 14:37:44.050364 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [req-7b6db4b8-1d65-4c06-a10d-618c09d92afa req-2770c6e4-3b32-4c92-8bba-fde8f9ab48fc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069508 Aug 06 14:37:44.051527 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 457/866] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:37:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:37:44.350626 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [req-6600ba31-501a-421f-8bab-06342f57f51a req-25959e81-64c0-45cc-affb-d083d7c4ba1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b9f7623-548a-4f92-8f60-9d7ee92e0fac", "name": "network-vif-deleted", "tag": "f31381da-4bc7-4a30-94e4-9ebf8fa3aaf3"}]} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:37:44.360453 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-6600ba31-501a-421f-8bab-06342f57f51a req-25959e81-64c0-45cc-affb-d083d7c4ba1a service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:44.360938 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-6600ba31-501a-421f-8bab-06342f57f51a req-25959e81-64c0-45cc-affb-d083d7c4ba1a service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:44.361379 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-6600ba31-501a-421f-8bab-06342f57f51a req-25959e81-64c0-45cc-affb-d083d7c4ba1a service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:44.375155 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.compute.server_external_events [req-6600ba31-501a-421f-8bab-06342f57f51a req-25959e81-64c0-45cc-affb-d083d7c4ba1a service nova] Creating event network-vif-deleted:f31381da-4bc7-4a30-94e4-9ebf8fa3aaf3 for instance 8b9f7623-548a-4f92-8f60-9d7ee92e0fac on hv-cinder-85199 Aug 06 14:37:44.381411 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [req-6600ba31-501a-421f-8bab-06342f57f51a req-25959e81-64c0-45cc-affb-d083d7c4ba1a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034380 Aug 06 14:37:44.382204 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 410/867] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:37:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:37:44.895139 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-824c9a41-c0a7-40f9-94c7-cb5fdbcc4027 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:37:44.896076 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-824c9a41-c0a7-40f9-94c7-cb5fdbcc4027 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 8805d1fa-6d65-45c7-ae75-17e46feccccb] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:37:44.902445 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-824c9a41-c0a7-40f9-94c7-cb5fdbcc4027 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:44.903101 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-824c9a41-c0a7-40f9-94c7-cb5fdbcc4027 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:44.903535 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-824c9a41-c0a7-40f9-94c7-cb5fdbcc4027 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:44.904227 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-824c9a41-c0a7-40f9-94c7-cb5fdbcc4027 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:44.905266 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-824c9a41-c0a7-40f9-94c7-cb5fdbcc4027 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:44.905836 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-824c9a41-c0a7-40f9-94c7-cb5fdbcc4027 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:44.921819 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.wsgi [None req-824c9a41-c0a7-40f9-94c7-cb5fdbcc4027 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] HTTP exception thrown: Instance 8805d1fa-6d65-45c7-ae75-17e46feccccb could not be found. Aug 06 14:37:44.923901 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-824c9a41-c0a7-40f9-94c7-cb5fdbcc4027 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Request method failure captured: Aug 06 14:37:44.923901 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: request: GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb HTTP/1.1 Aug 06 14:37:44.923901 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Accept: application/json Aug 06 14:37:44.923901 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Accept-Encoding: identity Aug 06 14:37:44.923901 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Connection: close Aug 06 14:37:44.923901 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Content-Length: 0 Aug 06 14:37:44.923901 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Content-Type: application/json Aug 06 14:37:44.923901 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Host: 10.222.0.17 Aug 06 14:37:44.923901 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Openstack-System-Scope: None Aug 06 14:37:44.923901 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: User-Agent: python-urllib3/1.26.11 Aug 06 14:37:44.923901 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Auth-Token: gAAAAABi7nreTiAQh7OGccJzMvpg6S4oeq9E7_giKG29ZsuQVMckwBo811MoZtHu7-VetjuRk3nZzucmu63Ww280erpCJunGj07pbSJnl4FV9pUrtMmgxWxHn25usemMXgtqgjhvbLrZ7mNdr87us3X1_BnoBfsvObjRpmug3z5gc_PZHaYrCyc Aug 06 14:37:44.923901 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Domain-Id: None Aug 06 14:37:44.923901 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Domain-Name: None Aug 06 14:37:44.923901 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Identity-Status: Confirmed Aug 06 14:37:44.923901 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Is-Admin-Project: True Aug 06 14:37:44.923901 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Domain-Id: default Aug 06 14:37:44.923901 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Domain-Name: Default Aug 06 14:37:44.923901 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Id: d19dc46cdcf549b0a6383c8b99d6f15f Aug 06 14:37:44.923901 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-379070379 Aug 06 14:37:44.923901 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Role: member,reader Aug 06 14:37:44.923901 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Roles: member,reader Aug 06 14:37:44.925314 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d19dc46cdcf549b0a6383c8b99d6f15f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d19dc46cdcf549b0a6383c8b99d6f15f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d19dc46cdcf549b0a6383c8b99d6f15f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d19dc46cdcf549b0a6383c8b99d6f15f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 06 14:37:44.925314 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant: tempest-ServerRescueNegativeTestJSON-379070379 Aug 06 14:37:44.925314 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant-Id: d19dc46cdcf549b0a6383c8b99d6f15f Aug 06 14:37:44.925314 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-379070379 Aug 06 14:37:44.925314 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User: tempest-ServerRescueNegativeTestJSON-379070379-project Aug 06 14:37:44.925314 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Domain-Id: default Aug 06 14:37:44.925314 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Domain-Name: Default Aug 06 14:37:44.925314 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Id: 4dadf737392d4153ae50de020534f070 Aug 06 14:37:44.925314 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Name: tempest-ServerRescueNegativeTestJSON-379070379-project Aug 06 14:37:44.925314 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: method: > Aug 06 14:37:44.925314 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: exception: Instance 8805d1fa-6d65-45c7-ae75-17e46feccccb could not be found. Aug 06 14:37:44.925314 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: action_args: {'id': '8805d1fa-6d65-45c7-ae75-17e46feccccb'} Aug 06 14:37:44.926104 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 14:37:44.926104 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:37:44.926104 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 14:37:44.926104 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 14:37:44.926104 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 14:37:44.926104 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 14:37:44.926104 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 14:37:44.926104 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 14:37:44.926104 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 14:37:44.926104 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 14:37:44.926104 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8805d1fa-6d65-45c7-ae75-17e46feccccb could not be found. Aug 06 14:37:44.926104 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:37:44.926104 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:37:44.926104 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:37:44.926104 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:37:44.926104 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:37:44.926104 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:37:44.926104 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 14:37:44.926104 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 14:37:44.926104 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 14:37:44.928180 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 14:37:44.928180 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 14:37:44.928180 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 14:37:44.928180 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 14:37:44.928180 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 14:37:44.928180 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 14:37:44.928180 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 14:37:44.928180 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8805d1fa-6d65-45c7-ae75-17e46feccccb could not be found. Aug 06 14:37:44.928180 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:37:44.928180 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:37:44.928180 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:37:44.928180 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:37:44.928180 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:37:44.928180 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:37:44.928180 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 14:37:44.928180 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 14:37:44.928180 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8805d1fa-6d65-45c7-ae75-17e46feccccb could not be found. Aug 06 14:37:44.928180 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:37:44.931392 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-824c9a41-c0a7-40f9-94c7-cb5fdbcc4027 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Returning 404 to user: Instance 8805d1fa-6d65-45c7-ae75-17e46feccccb could not be found. {{(pid=117837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 14:37:44.931550 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-ef7e3a6c-9704-4ccb-b508-642f3ac6eca4 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:37:44.932748 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-824c9a41-c0a7-40f9-94c7-cb5fdbcc4027 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb" status: 404 len: 111 microversion: 2.1 time: 0.035311 Aug 06 14:37:44.932931 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-ef7e3a6c-9704-4ccb-b508-642f3ac6eca4 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:37:44.933083 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 458/868] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:37:44 2022] GET /compute/v2.1/servers/8805d1fa-6d65-45c7-ae75-17e46feccccb => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 14:37:44.937578 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ef7e3a6c-9704-4ccb-b508-642f3ac6eca4 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:44.938069 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ef7e3a6c-9704-4ccb-b508-642f3ac6eca4 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:44.938599 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ef7e3a6c-9704-4ccb-b508-642f3ac6eca4 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:44.942108 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-f6e175f0-690e-46bb-9d27-caf02474e5cb tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '.version_select at 0x7fbab5cbdaf0>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:37:44.945050 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ef7e3a6c-9704-4ccb-b508-642f3ac6eca4 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:44.945551 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ef7e3a6c-9704-4ccb-b508-642f3ac6eca4 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:44.945985 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ef7e3a6c-9704-4ccb-b508-642f3ac6eca4 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:44.975244 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-f6e175f0-690e-46bb-9d27-caf02474e5cb tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-660528770" status: 202 len: 0 microversion: 2.1 time: 0.043782 Aug 06 14:37:44.979745 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 459/869] 10.222.0.17 () {58 vars in 1218 bytes} [Sat Aug 6 14:37:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-660528770 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 14:37:45.002485 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ef7e3a6c-9704-4ccb-b508-642f3ac6eca4 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:45.003065 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ef7e3a6c-9704-4ccb-b508-642f3ac6eca4 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:45.003505 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ef7e3a6c-9704-4ccb-b508-642f3ac6eca4 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:45.004014 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.objects.instance [None req-ef7e3a6c-9704-4ccb-b508-642f3ac6eca4 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lazy-loading 'fault' on Instance uuid 8b9f7623-548a-4f92-8f60-9d7ee92e0fac {{(pid=117838) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 14:37:45.068815 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-ef7e3a6c-9704-4ccb-b508-642f3ac6eca4 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:37:45.082171 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-ef7e3a6c-9704-4ccb-b508-642f3ac6eca4 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 200 len: 1327 microversion: 2.1 time: 0.161138 Aug 06 14:37:45.083920 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 411/870] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:37:44 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 1327 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:37:46.104885 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-15f4e399-942e-422d-877d-69e65ca8cf27 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:37:46.105485 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-15f4e399-942e-422d-877d-69e65ca8cf27 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:37:46.115036 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-15f4e399-942e-422d-877d-69e65ca8cf27 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:46.115518 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-15f4e399-942e-422d-877d-69e65ca8cf27 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:46.115961 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-15f4e399-942e-422d-877d-69e65ca8cf27 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:46.116631 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-15f4e399-942e-422d-877d-69e65ca8cf27 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:46.117083 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-15f4e399-942e-422d-877d-69e65ca8cf27 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:46.117505 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-15f4e399-942e-422d-877d-69e65ca8cf27 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:46.130279 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.wsgi [None req-15f4e399-942e-422d-877d-69e65ca8cf27 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] HTTP exception thrown: Instance 8b9f7623-548a-4f92-8f60-9d7ee92e0fac could not be found. Aug 06 14:37:46.131846 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-15f4e399-942e-422d-877d-69e65ca8cf27 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Request method failure captured: Aug 06 14:37:46.131846 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: request: GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac HTTP/1.1 Aug 06 14:37:46.131846 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Accept: application/json Aug 06 14:37:46.131846 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Accept-Encoding: identity Aug 06 14:37:46.131846 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Connection: close Aug 06 14:37:46.131846 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Content-Length: 0 Aug 06 14:37:46.131846 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Content-Type: application/json Aug 06 14:37:46.131846 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Host: 10.222.0.17 Aug 06 14:37:46.131846 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Openstack-System-Scope: None Aug 06 14:37:46.131846 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: User-Agent: python-urllib3/1.26.11 Aug 06 14:37:46.131846 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Auth-Token: gAAAAABi7nr59NgGbxivLiK18VWB0XiiDtxp0PLtFFiLiXSXaRHTpXpwyOZtsmZzTOVR5AS_8JU0kJ8QI2ROJLr2EyNbK_gorp9MlUB3uEgEGNAnkHJm1dOAHnr-UKSbZxoNr-_Dlz05vNvs4b3T6VfhWxUqU7iFjLljGv9q-XXPb5O8Lad9rDA Aug 06 14:37:46.131846 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Domain-Id: None Aug 06 14:37:46.131846 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Domain-Name: None Aug 06 14:37:46.131846 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Identity-Status: Confirmed Aug 06 14:37:46.131846 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Is-Admin-Project: True Aug 06 14:37:46.131846 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Domain-Id: default Aug 06 14:37:46.131846 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Domain-Name: Default Aug 06 14:37:46.131846 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Id: c17d83661330425d8c75a2562df8e16e Aug 06 14:37:46.131846 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Name: tempest-AttachVolumeTestJSON-1474795993 Aug 06 14:37:46.131846 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Role: member,reader Aug 06 14:37:46.131846 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Roles: member,reader Aug 06 14:37:46.133442 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c17d83661330425d8c75a2562df8e16e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c17d83661330425d8c75a2562df8e16e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c17d83661330425d8c75a2562df8e16e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c17d83661330425d8c75a2562df8e16e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 06 14:37:46.133442 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant: tempest-AttachVolumeTestJSON-1474795993 Aug 06 14:37:46.133442 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant-Id: c17d83661330425d8c75a2562df8e16e Aug 06 14:37:46.133442 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1474795993 Aug 06 14:37:46.133442 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User: tempest-AttachVolumeTestJSON-1474795993-project Aug 06 14:37:46.133442 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Domain-Id: default Aug 06 14:37:46.133442 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Domain-Name: Default Aug 06 14:37:46.133442 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Id: a3e987dfd35f4a5da36d5034970fcf59 Aug 06 14:37:46.133442 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Name: tempest-AttachVolumeTestJSON-1474795993-project Aug 06 14:37:46.133442 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: method: > Aug 06 14:37:46.133442 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: exception: Instance 8b9f7623-548a-4f92-8f60-9d7ee92e0fac could not be found. Aug 06 14:37:46.133442 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: action_args: {'id': '8b9f7623-548a-4f92-8f60-9d7ee92e0fac'} Aug 06 14:37:46.134383 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 14:37:46.134383 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:37:46.134383 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 14:37:46.134383 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 14:37:46.134383 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 14:37:46.134383 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 14:37:46.134383 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 14:37:46.134383 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 14:37:46.134383 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 14:37:46.134383 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 14:37:46.134383 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b9f7623-548a-4f92-8f60-9d7ee92e0fac could not be found. Aug 06 14:37:46.134383 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:37:46.134383 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:37:46.134383 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:37:46.134383 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:37:46.134383 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:37:46.134383 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:37:46.134383 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 14:37:46.134383 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 14:37:46.134383 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 14:37:46.135844 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 14:37:46.135844 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 14:37:46.135844 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 14:37:46.135844 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 14:37:46.135844 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 14:37:46.135844 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 14:37:46.135844 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 14:37:46.135844 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b9f7623-548a-4f92-8f60-9d7ee92e0fac could not be found. Aug 06 14:37:46.135844 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:37:46.135844 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:37:46.135844 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:37:46.135844 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:37:46.135844 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:37:46.135844 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:37:46.135844 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 14:37:46.135844 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 14:37:46.135844 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b9f7623-548a-4f92-8f60-9d7ee92e0fac could not be found. Aug 06 14:37:46.135844 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:37:46.137134 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-15f4e399-942e-422d-877d-69e65ca8cf27 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Returning 404 to user: Instance 8b9f7623-548a-4f92-8f60-9d7ee92e0fac could not be found. {{(pid=117837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 14:37:46.137134 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-15f4e399-942e-422d-877d-69e65ca8cf27 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 404 len: 111 microversion: 2.1 time: 0.033103 Aug 06 14:37:46.137134 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 460/871] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:37:46 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 14:37:46.142666 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-0ec9e375-36fc-4b41-8652-8ca0bc0b222e tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '.version_select at 0x7fbab12d2ca0>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:37:46.165566 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-0ec9e375-36fc-4b41-8652-8ca0bc0b222e tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1874721494" status: 202 len: 0 microversion: 2.1 time: 0.027127 Aug 06 14:37:46.166116 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 412/872] 10.222.0.17 () {58 vars in 1221 bytes} [Sat Aug 6 14:37:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1874721494 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 14:37:46.772211 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-af0aee25-7185-422b-af96-8103f45947fe tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Action: 'create', calling method: .version_select at 0x7fbab5c7e9d0>, body: {"keypair": {"name": "tempest-keypair-1428514355", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNxzYIU4rDxqxM0vANoh33jFVTeUXeOYig5uAsrodcCcdoU190mgBeGMBimhhEpq/CoRtzLs+RvEOGCWnhVdTIrTJJYJScL5II8z3Q7WVRYWhp9D0NwxFYUPh6Oesaifsw=="}} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:37:46.787320 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.quota [None req-af0aee25-7185-422b-af96-8103f45947fe tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Getting quotas for project c17d83661330425d8c75a2562df8e16e. Resources: {'key_pairs'} {{(pid=117837) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 14:37:46.791324 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.quota [None req-af0aee25-7185-422b-af96-8103f45947fe tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Getting quotas for user a3e987dfd35f4a5da36d5034970fcf59 and project c17d83661330425d8c75a2562df8e16e. Resources: {'key_pairs'} {{(pid=117837) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 14:37:46.815155 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-af0aee25-7185-422b-af96-8103f45947fe tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046699 Aug 06 14:37:46.815745 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 461/873] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Aug 6 14:37:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 14:37:47.940342 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-b4a88bdb-4695-401c-a9f6-c2a1767899be tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:37:47.940908 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-b4a88bdb-4695-401c-a9f6-c2a1767899be tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:37:47.947946 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b4a88bdb-4695-401c-a9f6-c2a1767899be tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:47.948544 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b4a88bdb-4695-401c-a9f6-c2a1767899be tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:47.949055 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b4a88bdb-4695-401c-a9f6-c2a1767899be tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:47.950106 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b4a88bdb-4695-401c-a9f6-c2a1767899be tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:47.950818 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b4a88bdb-4695-401c-a9f6-c2a1767899be tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:47.951420 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b4a88bdb-4695-401c-a9f6-c2a1767899be tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:47.978130 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-b4a88bdb-4695-401c-a9f6-c2a1767899be tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Going to try to terminate instance {{(pid=117838) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 14:37:48.053921 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-b4a88bdb-4695-401c-a9f6-c2a1767899be tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "DELETE /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 204 len: 0 microversion: 2.1 time: 0.117801 Aug 06 14:37:48.054609 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 413/874] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Aug 6 14:37:47 2022] DELETE /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 14:37:48.064525 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-70f85c56-1b50-4bd3-93e6-7f50aa45d29c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:37:48.065211 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-70f85c56-1b50-4bd3-93e6-7f50aa45d29c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:37:48.072314 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-70f85c56-1b50-4bd3-93e6-7f50aa45d29c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:48.072796 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-70f85c56-1b50-4bd3-93e6-7f50aa45d29c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:48.073226 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-70f85c56-1b50-4bd3-93e6-7f50aa45d29c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:48.073913 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-70f85c56-1b50-4bd3-93e6-7f50aa45d29c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:48.074366 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-70f85c56-1b50-4bd3-93e6-7f50aa45d29c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:48.074783 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-70f85c56-1b50-4bd3-93e6-7f50aa45d29c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:48.095511 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-947aaf42-78a8-43a8-9c06-da9d61e4b901 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1212683796", "imageRef": "13d7ee60-c9c3-43ee-9861-a9192a114a77", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "34c7591e-0655-4c97-99f3-35953970c98c"}], "security_groups": [{"name": "tempest-securitygroup--1668550146"}], "key_name": "tempest-keypair-1428514355", "user_data": "}} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:37:48.201067 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.network.neutron [None req-947aaf42-78a8-43a8-9c06-da9d61e4b901 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] validate_networks() for [('34c7591e-0655-4c97-99f3-35953970c98c', None, None, None, None, None)] {{(pid=117838) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 14:37:48.214075 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-70f85c56-1b50-4bd3-93e6-7f50aa45d29c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:37:48.223365 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-70f85c56-1b50-4bd3-93e6-7f50aa45d29c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1507 microversion: 2.1 time: 0.164035 Aug 06 14:37:48.224050 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 462/875] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:37:48 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1507 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:37:48.656798 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.virt.hardware [None req-947aaf42-78a8-43a8-9c06-da9d61e4b901 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Flavor limits 0:0:0 {{(pid=117838) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 14:37:48.657224 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.virt.hardware [None req-947aaf42-78a8-43a8-9c06-da9d61e4b901 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Image limits 0:0:0 {{(pid=117838) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 14:37:48.657713 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.virt.hardware [None req-947aaf42-78a8-43a8-9c06-da9d61e4b901 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Flavor pref 0:0:0 {{(pid=117838) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 14:37:48.658121 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.virt.hardware [None req-947aaf42-78a8-43a8-9c06-da9d61e4b901 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Image pref 0:0:0 {{(pid=117838) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 14:37:48.658529 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.virt.hardware [None req-947aaf42-78a8-43a8-9c06-da9d61e4b901 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117838) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 14:37:48.667265 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-947aaf42-78a8-43a8-9c06-da9d61e4b901 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:48.667743 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-947aaf42-78a8-43a8-9c06-da9d61e4b901 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:48.668178 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-947aaf42-78a8-43a8-9c06-da9d61e4b901 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:48.668906 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-947aaf42-78a8-43a8-9c06-da9d61e4b901 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:48.669357 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-947aaf42-78a8-43a8-9c06-da9d61e4b901 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:48.669779 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-947aaf42-78a8-43a8-9c06-da9d61e4b901 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:48.687306 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.quota [None req-947aaf42-78a8-43a8-9c06-da9d61e4b901 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Getting quotas for project c17d83661330425d8c75a2562df8e16e. Resources: {'cores', 'instances', 'ram'} {{(pid=117838) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 14:37:48.691189 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.quota [None req-947aaf42-78a8-43a8-9c06-da9d61e4b901 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Getting quotas for user a3e987dfd35f4a5da36d5034970fcf59 and project c17d83661330425d8c75a2562df8e16e. Resources: {'cores', 'instances', 'ram'} {{(pid=117838) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 14:37:48.701882 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-947aaf42-78a8-43a8-9c06-da9d61e4b901 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Going to run 1 instances... {{(pid=117838) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 14:37:48.704206 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-947aaf42-78a8-43a8-9c06-da9d61e4b901 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8cd3b906-abcb-4669-9d1b-0dd3133ec23e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='13d7ee60-c9c3-43ee-9861-a9192a114a77',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117838) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 14:37:48.754537 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-947aaf42-78a8-43a8-9c06-da9d61e4b901 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.663733 Aug 06 14:37:48.755215 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 414/876] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Aug 6 14:37:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 06 14:37:48.766183 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-961dbf30-4dcd-432a-99d2-2fca5a51a84b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:37:48.766885 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-961dbf30-4dcd-432a-99d2-2fca5a51a84b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8cd3b906-abcb-4669-9d1b-0dd3133ec23e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:37:48.819821 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-961dbf30-4dcd-432a-99d2-2fca5a51a84b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:37:48.826571 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-961dbf30-4dcd-432a-99d2-2fca5a51a84b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8cd3b906-abcb-4669-9d1b-0dd3133ec23e" status: 200 len: 1238 microversion: 2.1 time: 0.064499 Aug 06 14:37:48.827159 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 463/877] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:37:48 2022] GET /compute/v2.1/servers/8cd3b906-abcb-4669-9d1b-0dd3133ec23e => generated 1238 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:37:49.245025 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-c8c3ca9b-e76d-48b3-a86a-eacd41ff9bdf tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:37:49.246414 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-c8c3ca9b-e76d-48b3-a86a-eacd41ff9bdf tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:37:49.252821 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c8c3ca9b-e76d-48b3-a86a-eacd41ff9bdf tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:49.253420 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c8c3ca9b-e76d-48b3-a86a-eacd41ff9bdf tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:49.253944 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c8c3ca9b-e76d-48b3-a86a-eacd41ff9bdf tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:49.255051 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c8c3ca9b-e76d-48b3-a86a-eacd41ff9bdf tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:49.255580 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c8c3ca9b-e76d-48b3-a86a-eacd41ff9bdf tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:49.256130 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c8c3ca9b-e76d-48b3-a86a-eacd41ff9bdf tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:49.483496 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [req-a3ffc90c-7adc-4590-991c-0200ae141816 req-c77aa280-aa44-4730-975f-0678c42b01da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02ac0364-de9e-4a71-8210-dc3fcd23a33e", "name": "network-vif-deleted", "tag": "d9afb021-ae4d-4646-9676-3bc5246cf024"}]} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:37:49.484453 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-c8c3ca9b-e76d-48b3-a86a-eacd41ff9bdf tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:37:49.493880 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-c8c3ca9b-e76d-48b3-a86a-eacd41ff9bdf tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 200 len: 1507 microversion: 2.1 time: 0.253688 Aug 06 14:37:49.494365 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-a3ffc90c-7adc-4590-991c-0200ae141816 req-c77aa280-aa44-4730-975f-0678c42b01da service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:49.494742 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 415/878] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:37:49 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 1507 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:37:49.499332 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-a3ffc90c-7adc-4590-991c-0200ae141816 req-c77aa280-aa44-4730-975f-0678c42b01da service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:49.499851 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-a3ffc90c-7adc-4590-991c-0200ae141816 req-c77aa280-aa44-4730-975f-0678c42b01da service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:49.510671 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.compute.server_external_events [req-a3ffc90c-7adc-4590-991c-0200ae141816 req-c77aa280-aa44-4730-975f-0678c42b01da service nova] Creating event network-vif-deleted:d9afb021-ae4d-4646-9676-3bc5246cf024 for instance 02ac0364-de9e-4a71-8210-dc3fcd23a33e on hv-cinder-85199 Aug 06 14:37:49.516473 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [req-a3ffc90c-7adc-4590-991c-0200ae141816 req-c77aa280-aa44-4730-975f-0678c42b01da service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037809 Aug 06 14:37:49.517229 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 464/879] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:37:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 14:37:49.850329 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-ac93fd26-2533-4f4b-8a33-cc7e241acb1d tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:37:49.853727 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-ac93fd26-2533-4f4b-8a33-cc7e241acb1d tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8cd3b906-abcb-4669-9d1b-0dd3133ec23e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:37:49.866502 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ac93fd26-2533-4f4b-8a33-cc7e241acb1d tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:49.867495 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ac93fd26-2533-4f4b-8a33-cc7e241acb1d tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:49.868267 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ac93fd26-2533-4f4b-8a33-cc7e241acb1d tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:49.869235 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ac93fd26-2533-4f4b-8a33-cc7e241acb1d tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:49.869845 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ac93fd26-2533-4f4b-8a33-cc7e241acb1d tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:49.870485 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ac93fd26-2533-4f4b-8a33-cc7e241acb1d tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:49.969508 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-ac93fd26-2533-4f4b-8a33-cc7e241acb1d tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:37:49.977058 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-ac93fd26-2533-4f4b-8a33-cc7e241acb1d tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8cd3b906-abcb-4669-9d1b-0dd3133ec23e" status: 200 len: 1298 microversion: 2.1 time: 0.131574 Aug 06 14:37:49.977621 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 416/880] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:37:49 2022] GET /compute/v2.1/servers/8cd3b906-abcb-4669-9d1b-0dd3133ec23e => generated 1298 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:37:50.515997 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-79f9477d-b231-44c3-bdaf-c691aa51e7ee tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:37:50.516691 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-79f9477d-b231-44c3-bdaf-c691aa51e7ee tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: 02ac0364-de9e-4a71-8210-dc3fcd23a33e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:37:50.522638 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-79f9477d-b231-44c3-bdaf-c691aa51e7ee tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:50.523149 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-79f9477d-b231-44c3-bdaf-c691aa51e7ee tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:50.523579 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-79f9477d-b231-44c3-bdaf-c691aa51e7ee tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:50.524260 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-79f9477d-b231-44c3-bdaf-c691aa51e7ee tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:50.524708 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-79f9477d-b231-44c3-bdaf-c691aa51e7ee tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:50.525125 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-79f9477d-b231-44c3-bdaf-c691aa51e7ee tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:50.538649 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.wsgi [None req-79f9477d-b231-44c3-bdaf-c691aa51e7ee tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] HTTP exception thrown: Instance 02ac0364-de9e-4a71-8210-dc3fcd23a33e could not be found. Aug 06 14:37:50.540320 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-79f9477d-b231-44c3-bdaf-c691aa51e7ee tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Request method failure captured: Aug 06 14:37:50.540320 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: request: GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e HTTP/1.1 Aug 06 14:37:50.540320 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Accept: application/json Aug 06 14:37:50.540320 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Accept-Encoding: identity Aug 06 14:37:50.540320 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Connection: close Aug 06 14:37:50.540320 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Content-Length: 0 Aug 06 14:37:50.540320 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Content-Type: application/json Aug 06 14:37:50.540320 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Host: 10.222.0.17 Aug 06 14:37:50.540320 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Openstack-System-Scope: None Aug 06 14:37:50.540320 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: User-Agent: python-urllib3/1.26.11 Aug 06 14:37:50.540320 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Auth-Token: gAAAAABi7nreTiAQh7OGccJzMvpg6S4oeq9E7_giKG29ZsuQVMckwBo811MoZtHu7-VetjuRk3nZzucmu63Ww280erpCJunGj07pbSJnl4FV9pUrtMmgxWxHn25usemMXgtqgjhvbLrZ7mNdr87us3X1_BnoBfsvObjRpmug3z5gc_PZHaYrCyc Aug 06 14:37:50.540320 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Domain-Id: None Aug 06 14:37:50.540320 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Domain-Name: None Aug 06 14:37:50.540320 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Identity-Status: Confirmed Aug 06 14:37:50.540320 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Is-Admin-Project: True Aug 06 14:37:50.540320 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Domain-Id: default Aug 06 14:37:50.540320 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Domain-Name: Default Aug 06 14:37:50.540320 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Id: d19dc46cdcf549b0a6383c8b99d6f15f Aug 06 14:37:50.540320 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-379070379 Aug 06 14:37:50.540320 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Role: member,reader Aug 06 14:37:50.540320 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Roles: member,reader Aug 06 14:37:50.541942 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d19dc46cdcf549b0a6383c8b99d6f15f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d19dc46cdcf549b0a6383c8b99d6f15f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d19dc46cdcf549b0a6383c8b99d6f15f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d19dc46cdcf549b0a6383c8b99d6f15f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 06 14:37:50.541942 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant: tempest-ServerRescueNegativeTestJSON-379070379 Aug 06 14:37:50.541942 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant-Id: d19dc46cdcf549b0a6383c8b99d6f15f Aug 06 14:37:50.541942 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-379070379 Aug 06 14:37:50.541942 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User: tempest-ServerRescueNegativeTestJSON-379070379-project Aug 06 14:37:50.541942 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Domain-Id: default Aug 06 14:37:50.541942 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Domain-Name: Default Aug 06 14:37:50.541942 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Id: 4dadf737392d4153ae50de020534f070 Aug 06 14:37:50.541942 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Name: tempest-ServerRescueNegativeTestJSON-379070379-project Aug 06 14:37:50.541942 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: method: > Aug 06 14:37:50.541942 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: exception: Instance 02ac0364-de9e-4a71-8210-dc3fcd23a33e could not be found. Aug 06 14:37:50.541942 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: action_args: {'id': '02ac0364-de9e-4a71-8210-dc3fcd23a33e'} Aug 06 14:37:50.543043 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 14:37:50.543043 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:37:50.543043 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 14:37:50.543043 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 14:37:50.543043 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 14:37:50.543043 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 14:37:50.543043 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 14:37:50.543043 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 14:37:50.543043 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 14:37:50.543043 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 14:37:50.543043 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02ac0364-de9e-4a71-8210-dc3fcd23a33e could not be found. Aug 06 14:37:50.543043 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:37:50.543043 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:37:50.543043 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:37:50.543043 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:37:50.543043 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:37:50.543043 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:37:50.543043 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 14:37:50.543043 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 14:37:50.543043 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 14:37:50.544622 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 14:37:50.544622 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 14:37:50.544622 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 14:37:50.544622 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 14:37:50.544622 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 14:37:50.544622 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 14:37:50.544622 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 14:37:50.544622 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02ac0364-de9e-4a71-8210-dc3fcd23a33e could not be found. Aug 06 14:37:50.544622 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:37:50.544622 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:37:50.544622 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:37:50.544622 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:37:50.544622 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:37:50.544622 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:37:50.544622 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 14:37:50.544622 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 14:37:50.544622 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02ac0364-de9e-4a71-8210-dc3fcd23a33e could not be found. Aug 06 14:37:50.544622 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:37:50.546961 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-79f9477d-b231-44c3-bdaf-c691aa51e7ee tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Returning 404 to user: Instance 02ac0364-de9e-4a71-8210-dc3fcd23a33e could not be found. {{(pid=117837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 14:37:50.546961 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-79f9477d-b231-44c3-bdaf-c691aa51e7ee tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e" status: 404 len: 111 microversion: 2.1 time: 0.030441 Aug 06 14:37:50.546961 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 465/881] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:37:50 2022] GET /compute/v2.1/servers/02ac0364-de9e-4a71-8210-dc3fcd23a33e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 14:37:50.551644 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-0ea384ef-ee5e-42b4-8287-1bbd8cd1fbed tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:37:50.552141 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-0ea384ef-ee5e-42b4-8287-1bbd8cd1fbed tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: d1cbde5c-7d9e-49cc-ba65-31507c04c60b] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:37:50.558799 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0ea384ef-ee5e-42b4-8287-1bbd8cd1fbed tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:50.559310 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0ea384ef-ee5e-42b4-8287-1bbd8cd1fbed tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:50.559732 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0ea384ef-ee5e-42b4-8287-1bbd8cd1fbed tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:50.560441 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0ea384ef-ee5e-42b4-8287-1bbd8cd1fbed tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:50.560941 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0ea384ef-ee5e-42b4-8287-1bbd8cd1fbed tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:50.561375 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0ea384ef-ee5e-42b4-8287-1bbd8cd1fbed tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:50.589573 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-0ea384ef-ee5e-42b4-8287-1bbd8cd1fbed tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: d1cbde5c-7d9e-49cc-ba65-31507c04c60b] Going to try to terminate instance {{(pid=117838) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 14:37:50.634288 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:37:50.669958 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-0ea384ef-ee5e-42b4-8287-1bbd8cd1fbed tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b" status: 204 len: 0 microversion: 2.1 time: 0.121396 Aug 06 14:37:50.670705 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 417/882] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Aug 6 14:37:50 2022] DELETE /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 14:37:50.679826 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-8ff0e9bc-6f9d-47a3-aedb-a4e0a5e51e5c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:37:50.680426 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-8ff0e9bc-6f9d-47a3-aedb-a4e0a5e51e5c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: d1cbde5c-7d9e-49cc-ba65-31507c04c60b] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:37:50.686633 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8ff0e9bc-6f9d-47a3-aedb-a4e0a5e51e5c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:50.687079 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8ff0e9bc-6f9d-47a3-aedb-a4e0a5e51e5c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:50.687507 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8ff0e9bc-6f9d-47a3-aedb-a4e0a5e51e5c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:50.688192 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8ff0e9bc-6f9d-47a3-aedb-a4e0a5e51e5c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:50.688636 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8ff0e9bc-6f9d-47a3-aedb-a4e0a5e51e5c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:50.689051 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8ff0e9bc-6f9d-47a3-aedb-a4e0a5e51e5c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:50.822904 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-8ff0e9bc-6f9d-47a3-aedb-a4e0a5e51e5c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:37:50.831727 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-8ff0e9bc-6f9d-47a3-aedb-a4e0a5e51e5c tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b" status: 200 len: 1522 microversion: 2.1 time: 0.156614 Aug 06 14:37:50.832379 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 466/883] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:37:50 2022] GET /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:37:50.998126 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-2bfd1930-d73b-4dba-a469-b16d3eb83c8a tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:37:50.999342 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-2bfd1930-d73b-4dba-a469-b16d3eb83c8a tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8cd3b906-abcb-4669-9d1b-0dd3133ec23e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:37:51.005238 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2bfd1930-d73b-4dba-a469-b16d3eb83c8a tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:51.005722 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2bfd1930-d73b-4dba-a469-b16d3eb83c8a tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:51.006157 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2bfd1930-d73b-4dba-a469-b16d3eb83c8a tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:51.006845 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2bfd1930-d73b-4dba-a469-b16d3eb83c8a tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:51.007320 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2bfd1930-d73b-4dba-a469-b16d3eb83c8a tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:51.007740 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2bfd1930-d73b-4dba-a469-b16d3eb83c8a tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:51.254412 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-2bfd1930-d73b-4dba-a469-b16d3eb83c8a tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:37:51.262665 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-2bfd1930-d73b-4dba-a469-b16d3eb83c8a tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8cd3b906-abcb-4669-9d1b-0dd3133ec23e" status: 200 len: 1364 microversion: 2.1 time: 0.268734 Aug 06 14:37:51.263259 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 418/884] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:37:50 2022] GET /compute/v2.1/servers/8cd3b906-abcb-4669-9d1b-0dd3133ec23e => generated 1364 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:37:51.640819 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [req-1680c13d-b8fd-4d28-8408-530f14925879 req-ef05eee8-6616-43a0-8e01-1e6a948fd731 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cd3b906-abcb-4669-9d1b-0dd3133ec23e", "tag": "1dfff01d-0a08-4442-88d9-0edaf57e0f1a"}]} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:37:51.650562 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-1680c13d-b8fd-4d28-8408-530f14925879 req-ef05eee8-6616-43a0-8e01-1e6a948fd731 service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:51.651077 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-1680c13d-b8fd-4d28-8408-530f14925879 req-ef05eee8-6616-43a0-8e01-1e6a948fd731 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:51.651506 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-1680c13d-b8fd-4d28-8408-530f14925879 req-ef05eee8-6616-43a0-8e01-1e6a948fd731 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:51.662480 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.compute.server_external_events [req-1680c13d-b8fd-4d28-8408-530f14925879 req-ef05eee8-6616-43a0-8e01-1e6a948fd731 service nova] Creating event network-changed:1dfff01d-0a08-4442-88d9-0edaf57e0f1a for instance 8cd3b906-abcb-4669-9d1b-0dd3133ec23e on hv-cinder-85199 Aug 06 14:37:51.667101 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [req-1680c13d-b8fd-4d28-8408-530f14925879 req-ef05eee8-6616-43a0-8e01-1e6a948fd731 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029899 Aug 06 14:37:51.667874 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 467/885] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:37:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:37:51.853617 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-49725bf9-a5ad-4966-9bfc-cccd2548cef7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:37:51.854220 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-49725bf9-a5ad-4966-9bfc-cccd2548cef7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: d1cbde5c-7d9e-49cc-ba65-31507c04c60b] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:37:51.861070 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-49725bf9-a5ad-4966-9bfc-cccd2548cef7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:51.861552 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-49725bf9-a5ad-4966-9bfc-cccd2548cef7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:51.862007 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-49725bf9-a5ad-4966-9bfc-cccd2548cef7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:51.862977 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-49725bf9-a5ad-4966-9bfc-cccd2548cef7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:51.863588 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-49725bf9-a5ad-4966-9bfc-cccd2548cef7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:51.864167 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-49725bf9-a5ad-4966-9bfc-cccd2548cef7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:52.285461 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-d5950deb-2398-42a7-ba4e-09e374f0d82e tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:37:52.286385 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-d5950deb-2398-42a7-ba4e-09e374f0d82e tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8cd3b906-abcb-4669-9d1b-0dd3133ec23e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:37:52.293189 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d5950deb-2398-42a7-ba4e-09e374f0d82e tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:52.293805 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d5950deb-2398-42a7-ba4e-09e374f0d82e tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:52.294339 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d5950deb-2398-42a7-ba4e-09e374f0d82e tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:52.295425 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d5950deb-2398-42a7-ba4e-09e374f0d82e tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:52.295962 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d5950deb-2398-42a7-ba4e-09e374f0d82e tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:52.296497 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d5950deb-2398-42a7-ba4e-09e374f0d82e tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:52.334802 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-49725bf9-a5ad-4966-9bfc-cccd2548cef7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:37:52.342959 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-49725bf9-a5ad-4966-9bfc-cccd2548cef7 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b" status: 200 len: 1522 microversion: 2.1 time: 0.492831 Aug 06 14:37:52.343523 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 419/886] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:37:51 2022] GET /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b => generated 1522 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:37:52.546346 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-d5950deb-2398-42a7-ba4e-09e374f0d82e tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:37:52.559151 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-d5950deb-2398-42a7-ba4e-09e374f0d82e tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8cd3b906-abcb-4669-9d1b-0dd3133ec23e" status: 200 len: 1364 microversion: 2.1 time: 0.277661 Aug 06 14:37:52.562273 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 468/887] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:37:52 2022] GET /compute/v2.1/servers/8cd3b906-abcb-4669-9d1b-0dd3133ec23e => generated 1364 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:37:53.363802 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-75efd653-e906-403d-8647-81609bd8eb91 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:37:53.364350 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-75efd653-e906-403d-8647-81609bd8eb91 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: d1cbde5c-7d9e-49cc-ba65-31507c04c60b] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:37:53.370674 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-75efd653-e906-403d-8647-81609bd8eb91 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:53.371183 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-75efd653-e906-403d-8647-81609bd8eb91 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:53.371617 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-75efd653-e906-403d-8647-81609bd8eb91 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:53.372300 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-75efd653-e906-403d-8647-81609bd8eb91 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:53.372755 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-75efd653-e906-403d-8647-81609bd8eb91 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:53.373182 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-75efd653-e906-403d-8647-81609bd8eb91 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:53.433043 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-75efd653-e906-403d-8647-81609bd8eb91 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:37:53.440528 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-75efd653-e906-403d-8647-81609bd8eb91 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b" status: 200 len: 1307 microversion: 2.1 time: 0.080703 Aug 06 14:37:53.441091 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 420/888] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:37:53 2022] GET /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b => generated 1307 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:37:53.581982 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-e76a02fc-5b87-4458-94e5-8e89ede74f1f tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:37:53.582587 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-e76a02fc-5b87-4458-94e5-8e89ede74f1f tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8cd3b906-abcb-4669-9d1b-0dd3133ec23e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:37:53.589275 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e76a02fc-5b87-4458-94e5-8e89ede74f1f tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:53.589750 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e76a02fc-5b87-4458-94e5-8e89ede74f1f tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:53.590178 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e76a02fc-5b87-4458-94e5-8e89ede74f1f tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:53.590853 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e76a02fc-5b87-4458-94e5-8e89ede74f1f tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:53.591329 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e76a02fc-5b87-4458-94e5-8e89ede74f1f tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:53.591743 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e76a02fc-5b87-4458-94e5-8e89ede74f1f tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:53.683369 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [req-7f1b74eb-4545-478e-a168-c3a5eaea47db req-3f61eb2a-73ee-4dec-9fea-d2217b6ae67c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1cbde5c-7d9e-49cc-ba65-31507c04c60b", "name": "network-vif-deleted", "tag": "a853325e-6939-4f2f-af26-cb207312c178"}]} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:37:53.692663 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-7f1b74eb-4545-478e-a168-c3a5eaea47db req-3f61eb2a-73ee-4dec-9fea-d2217b6ae67c service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:53.693142 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-7f1b74eb-4545-478e-a168-c3a5eaea47db req-3f61eb2a-73ee-4dec-9fea-d2217b6ae67c service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:53.693639 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-7f1b74eb-4545-478e-a168-c3a5eaea47db req-3f61eb2a-73ee-4dec-9fea-d2217b6ae67c service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:53.704718 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.compute.server_external_events [req-7f1b74eb-4545-478e-a168-c3a5eaea47db req-3f61eb2a-73ee-4dec-9fea-d2217b6ae67c service nova] Creating event network-vif-deleted:a853325e-6939-4f2f-af26-cb207312c178 for instance d1cbde5c-7d9e-49cc-ba65-31507c04c60b on hv-cinder-85199 Aug 06 14:37:53.709604 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [req-7f1b74eb-4545-478e-a168-c3a5eaea47db req-3f61eb2a-73ee-4dec-9fea-d2217b6ae67c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030030 Aug 06 14:37:53.710375 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 421/889] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:37:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 14:37:53.723824 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-e76a02fc-5b87-4458-94e5-8e89ede74f1f tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:37:53.731176 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-e76a02fc-5b87-4458-94e5-8e89ede74f1f tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8cd3b906-abcb-4669-9d1b-0dd3133ec23e" status: 200 len: 1364 microversion: 2.1 time: 0.152998 Aug 06 14:37:53.731721 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 469/890] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:37:53 2022] GET /compute/v2.1/servers/8cd3b906-abcb-4669-9d1b-0dd3133ec23e => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:37:54.461280 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-9f7a55c8-37ae-4393-99b3-5616b9e74c1f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:37:54.462041 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-9f7a55c8-37ae-4393-99b3-5616b9e74c1f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: d1cbde5c-7d9e-49cc-ba65-31507c04c60b] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:37:54.468749 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9f7a55c8-37ae-4393-99b3-5616b9e74c1f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:54.469234 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9f7a55c8-37ae-4393-99b3-5616b9e74c1f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:54.469668 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9f7a55c8-37ae-4393-99b3-5616b9e74c1f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:54.470351 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9f7a55c8-37ae-4393-99b3-5616b9e74c1f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:54.470804 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9f7a55c8-37ae-4393-99b3-5616b9e74c1f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:54.471255 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9f7a55c8-37ae-4393-99b3-5616b9e74c1f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:54.535083 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-9f7a55c8-37ae-4393-99b3-5616b9e74c1f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4dadf737392d4153ae50de020534f070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd19dc46cdcf549b0a6383c8b99d6f15f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:37:54.542530 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-9f7a55c8-37ae-4393-99b3-5616b9e74c1f tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b" status: 200 len: 1307 microversion: 2.1 time: 0.085453 Aug 06 14:37:54.543126 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 422/891] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:37:54 2022] GET /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b => generated 1307 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:37:54.751585 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-d235628e-b7e3-40e2-ab1f-ca31e7abe998 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:37:54.752121 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-d235628e-b7e3-40e2-ab1f-ca31e7abe998 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8cd3b906-abcb-4669-9d1b-0dd3133ec23e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:37:54.758417 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d235628e-b7e3-40e2-ab1f-ca31e7abe998 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:54.758924 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d235628e-b7e3-40e2-ab1f-ca31e7abe998 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:54.759364 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d235628e-b7e3-40e2-ab1f-ca31e7abe998 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:54.760044 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d235628e-b7e3-40e2-ab1f-ca31e7abe998 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:54.760536 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d235628e-b7e3-40e2-ab1f-ca31e7abe998 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:54.760959 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d235628e-b7e3-40e2-ab1f-ca31e7abe998 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:54.764934 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:37:54.897354 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-d235628e-b7e3-40e2-ab1f-ca31e7abe998 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:37:54.905515 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-d235628e-b7e3-40e2-ab1f-ca31e7abe998 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8cd3b906-abcb-4669-9d1b-0dd3133ec23e" status: 200 len: 1364 microversion: 2.1 time: 0.157843 Aug 06 14:37:54.906086 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 470/892] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:37:54 2022] GET /compute/v2.1/servers/8cd3b906-abcb-4669-9d1b-0dd3133ec23e => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:37:55.566239 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-25d1e543-c632-49c0-9e6e-043063386bc2 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:37:55.567304 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-25d1e543-c632-49c0-9e6e-043063386bc2 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] [instance: d1cbde5c-7d9e-49cc-ba65-31507c04c60b] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:37:55.575422 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-25d1e543-c632-49c0-9e6e-043063386bc2 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:55.575940 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-25d1e543-c632-49c0-9e6e-043063386bc2 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:55.577142 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-25d1e543-c632-49c0-9e6e-043063386bc2 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:55.577993 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-25d1e543-c632-49c0-9e6e-043063386bc2 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:55.578476 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-25d1e543-c632-49c0-9e6e-043063386bc2 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:55.578978 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-25d1e543-c632-49c0-9e6e-043063386bc2 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:55.593224 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.wsgi [None req-25d1e543-c632-49c0-9e6e-043063386bc2 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] HTTP exception thrown: Instance d1cbde5c-7d9e-49cc-ba65-31507c04c60b could not be found. Aug 06 14:37:55.594842 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-25d1e543-c632-49c0-9e6e-043063386bc2 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Request method failure captured: Aug 06 14:37:55.594842 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: request: GET /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b HTTP/1.1 Aug 06 14:37:55.594842 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Accept: application/json Aug 06 14:37:55.594842 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Accept-Encoding: identity Aug 06 14:37:55.594842 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Connection: close Aug 06 14:37:55.594842 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Content-Length: 0 Aug 06 14:37:55.594842 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Content-Type: application/json Aug 06 14:37:55.594842 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Host: 10.222.0.17 Aug 06 14:37:55.594842 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Openstack-System-Scope: None Aug 06 14:37:55.594842 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: User-Agent: python-urllib3/1.26.11 Aug 06 14:37:55.594842 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Auth-Token: gAAAAABi7nreTiAQh7OGccJzMvpg6S4oeq9E7_giKG29ZsuQVMckwBo811MoZtHu7-VetjuRk3nZzucmu63Ww280erpCJunGj07pbSJnl4FV9pUrtMmgxWxHn25usemMXgtqgjhvbLrZ7mNdr87us3X1_BnoBfsvObjRpmug3z5gc_PZHaYrCyc Aug 06 14:37:55.594842 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Domain-Id: None Aug 06 14:37:55.594842 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Domain-Name: None Aug 06 14:37:55.594842 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Identity-Status: Confirmed Aug 06 14:37:55.594842 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Is-Admin-Project: True Aug 06 14:37:55.594842 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Domain-Id: default Aug 06 14:37:55.594842 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Domain-Name: Default Aug 06 14:37:55.594842 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Id: d19dc46cdcf549b0a6383c8b99d6f15f Aug 06 14:37:55.594842 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-379070379 Aug 06 14:37:55.594842 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Role: member,reader Aug 06 14:37:55.594842 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Roles: member,reader Aug 06 14:37:55.596429 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d19dc46cdcf549b0a6383c8b99d6f15f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d19dc46cdcf549b0a6383c8b99d6f15f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d19dc46cdcf549b0a6383c8b99d6f15f", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d19dc46cdcf549b0a6383c8b99d6f15f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 06 14:37:55.596429 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Tenant: tempest-ServerRescueNegativeTestJSON-379070379 Aug 06 14:37:55.596429 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Tenant-Id: d19dc46cdcf549b0a6383c8b99d6f15f Aug 06 14:37:55.596429 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-379070379 Aug 06 14:37:55.596429 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User: tempest-ServerRescueNegativeTestJSON-379070379-project Aug 06 14:37:55.596429 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Domain-Id: default Aug 06 14:37:55.596429 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Domain-Name: Default Aug 06 14:37:55.596429 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Id: 4dadf737392d4153ae50de020534f070 Aug 06 14:37:55.596429 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Name: tempest-ServerRescueNegativeTestJSON-379070379-project Aug 06 14:37:55.596429 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: method: > Aug 06 14:37:55.596429 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: exception: Instance d1cbde5c-7d9e-49cc-ba65-31507c04c60b could not be found. Aug 06 14:37:55.596429 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: action_args: {'id': 'd1cbde5c-7d9e-49cc-ba65-31507c04c60b'} Aug 06 14:37:55.600720 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 14:37:55.600720 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:37:55.600720 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 14:37:55.600720 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 14:37:55.600720 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 14:37:55.600720 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 14:37:55.600720 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 14:37:55.600720 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 14:37:55.600720 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 14:37:55.600720 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 14:37:55.600720 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1cbde5c-7d9e-49cc-ba65-31507c04c60b could not be found. Aug 06 14:37:55.600720 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:37:55.600720 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:37:55.600720 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:37:55.600720 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:37:55.600720 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:37:55.600720 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:37:55.600720 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 14:37:55.600720 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 14:37:55.600720 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 14:37:55.602244 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 14:37:55.602244 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 14:37:55.602244 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 14:37:55.602244 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 14:37:55.602244 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 14:37:55.602244 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 14:37:55.602244 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 14:37:55.602244 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1cbde5c-7d9e-49cc-ba65-31507c04c60b could not be found. Aug 06 14:37:55.602244 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:37:55.602244 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:37:55.602244 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:37:55.602244 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:37:55.602244 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:37:55.602244 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:37:55.602244 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 14:37:55.602244 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 14:37:55.602244 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1cbde5c-7d9e-49cc-ba65-31507c04c60b could not be found. Aug 06 14:37:55.602244 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:37:55.604004 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-25d1e543-c632-49c0-9e6e-043063386bc2 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] Returning 404 to user: Instance d1cbde5c-7d9e-49cc-ba65-31507c04c60b could not be found. {{(pid=117838) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 14:37:55.604004 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-25d1e543-c632-49c0-9e6e-043063386bc2 tempest-ServerRescueNegativeTestJSON-379070379 tempest-ServerRescueNegativeTestJSON-379070379-project] 10.222.0.17 "GET /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b" status: 404 len: 111 microversion: 2.1 time: 0.036444 Aug 06 14:37:55.604004 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 423/893] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:37:55 2022] GET /compute/v2.1/servers/d1cbde5c-7d9e-49cc-ba65-31507c04c60b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 14:37:55.927018 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-870dcbdf-d268-4da9-8f32-0f3643e2efc2 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:37:55.927622 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-870dcbdf-d268-4da9-8f32-0f3643e2efc2 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8cd3b906-abcb-4669-9d1b-0dd3133ec23e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:37:55.934072 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-870dcbdf-d268-4da9-8f32-0f3643e2efc2 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:55.934554 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-870dcbdf-d268-4da9-8f32-0f3643e2efc2 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:55.935013 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-870dcbdf-d268-4da9-8f32-0f3643e2efc2 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:55.936369 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-870dcbdf-d268-4da9-8f32-0f3643e2efc2 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:55.936825 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-870dcbdf-d268-4da9-8f32-0f3643e2efc2 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:55.937243 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-870dcbdf-d268-4da9-8f32-0f3643e2efc2 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:56.067712 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-870dcbdf-d268-4da9-8f32-0f3643e2efc2 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:37:56.075292 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-870dcbdf-d268-4da9-8f32-0f3643e2efc2 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8cd3b906-abcb-4669-9d1b-0dd3133ec23e" status: 200 len: 1364 microversion: 2.1 time: 0.152098 Aug 06 14:37:56.075987 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 471/894] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:37:55 2022] GET /compute/v2.1/servers/8cd3b906-abcb-4669-9d1b-0dd3133ec23e => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:37:57.097870 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-6db228ab-ea36-424a-9a82-615e537a32f2 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:37:57.099314 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-6db228ab-ea36-424a-9a82-615e537a32f2 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8cd3b906-abcb-4669-9d1b-0dd3133ec23e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:37:57.106736 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6db228ab-ea36-424a-9a82-615e537a32f2 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:57.108321 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6db228ab-ea36-424a-9a82-615e537a32f2 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:57.108996 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6db228ab-ea36-424a-9a82-615e537a32f2 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:57.110016 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6db228ab-ea36-424a-9a82-615e537a32f2 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:57.110816 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6db228ab-ea36-424a-9a82-615e537a32f2 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:57.111498 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6db228ab-ea36-424a-9a82-615e537a32f2 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:57.302613 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [req-10801388-9f32-4225-8d40-21aaae4f6491 req-84852244-96a1-4bd7-9631-6b29d6e03a75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cd3b906-abcb-4669-9d1b-0dd3133ec23e", "name": "network-vif-plugged", "status": "completed", "tag": "1dfff01d-0a08-4442-88d9-0edaf57e0f1a"}]} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:37:57.318402 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-10801388-9f32-4225-8d40-21aaae4f6491 req-84852244-96a1-4bd7-9631-6b29d6e03a75 service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:57.320909 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-10801388-9f32-4225-8d40-21aaae4f6491 req-84852244-96a1-4bd7-9631-6b29d6e03a75 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:57.322133 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-10801388-9f32-4225-8d40-21aaae4f6491 req-84852244-96a1-4bd7-9631-6b29d6e03a75 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:57.340501 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.compute.server_external_events [req-10801388-9f32-4225-8d40-21aaae4f6491 req-84852244-96a1-4bd7-9631-6b29d6e03a75 service nova] Creating event network-vif-plugged:1dfff01d-0a08-4442-88d9-0edaf57e0f1a for instance 8cd3b906-abcb-4669-9d1b-0dd3133ec23e on hv-cinder-85199 Aug 06 14:37:57.350973 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [req-10801388-9f32-4225-8d40-21aaae4f6491 req-84852244-96a1-4bd7-9631-6b29d6e03a75 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056152 Aug 06 14:37:57.352654 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 472/895] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:37:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:37:57.360015 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-6db228ab-ea36-424a-9a82-615e537a32f2 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:37:57.369591 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-6db228ab-ea36-424a-9a82-615e537a32f2 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8cd3b906-abcb-4669-9d1b-0dd3133ec23e" status: 200 len: 1364 microversion: 2.1 time: 0.276194 Aug 06 14:37:57.371060 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 424/896] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:37:57 2022] GET /compute/v2.1/servers/8cd3b906-abcb-4669-9d1b-0dd3133ec23e => generated 1364 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:37:58.392194 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-eb5fc978-274e-40ac-b74c-9b6a2ae91e7e tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:37:58.393652 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-eb5fc978-274e-40ac-b74c-9b6a2ae91e7e tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8cd3b906-abcb-4669-9d1b-0dd3133ec23e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:37:58.417634 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-eb5fc978-274e-40ac-b74c-9b6a2ae91e7e tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:58.418677 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-eb5fc978-274e-40ac-b74c-9b6a2ae91e7e tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:58.419583 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-eb5fc978-274e-40ac-b74c-9b6a2ae91e7e tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:58.421789 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-eb5fc978-274e-40ac-b74c-9b6a2ae91e7e tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:58.422510 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-eb5fc978-274e-40ac-b74c-9b6a2ae91e7e tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:58.423192 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-eb5fc978-274e-40ac-b74c-9b6a2ae91e7e tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:58.586514 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-eb5fc978-274e-40ac-b74c-9b6a2ae91e7e tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:37:58.595929 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-eb5fc978-274e-40ac-b74c-9b6a2ae91e7e tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8cd3b906-abcb-4669-9d1b-0dd3133ec23e" status: 200 len: 1364 microversion: 2.1 time: 0.208181 Aug 06 14:37:58.610067 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 473/897] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:37:58 2022] GET /compute/v2.1/servers/8cd3b906-abcb-4669-9d1b-0dd3133ec23e => generated 1364 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:37:59.616591 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-20b88fb4-2880-4f70-acea-a5f46cb343db tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:37:59.617287 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-20b88fb4-2880-4f70-acea-a5f46cb343db tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8cd3b906-abcb-4669-9d1b-0dd3133ec23e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:37:59.621003 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_cell0:SELECT=2 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:37:59.621946 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_cell0:SELECT=6 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:37:59.626546 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-20b88fb4-2880-4f70-acea-a5f46cb343db tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:59.627353 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-20b88fb4-2880-4f70-acea-a5f46cb343db tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:59.627839 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-20b88fb4-2880-4f70-acea-a5f46cb343db tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:59.628479 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-20b88fb4-2880-4f70-acea-a5f46cb343db tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:59.629268 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-20b88fb4-2880-4f70-acea-a5f46cb343db tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:59.629690 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-20b88fb4-2880-4f70-acea-a5f46cb343db tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:59.772011 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-20b88fb4-2880-4f70-acea-a5f46cb343db tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:37:59.780003 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-20b88fb4-2880-4f70-acea-a5f46cb343db tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8cd3b906-abcb-4669-9d1b-0dd3133ec23e" status: 200 len: 1549 microversion: 2.1 time: 0.167452 Aug 06 14:37:59.780776 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 425/898] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:37:59 2022] GET /compute/v2.1/servers/8cd3b906-abcb-4669-9d1b-0dd3133ec23e => generated 1549 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:37:59.803683 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-6ab8b00c-7088-4b75-b426-c21fce55982b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:37:59.804415 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-6ab8b00c-7088-4b75-b426-c21fce55982b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8cd3b906-abcb-4669-9d1b-0dd3133ec23e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:37:59.807751 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_cell0:SELECT=6 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:37:59.814589 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6ab8b00c-7088-4b75-b426-c21fce55982b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:59.815201 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6ab8b00c-7088-4b75-b426-c21fce55982b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:59.815698 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6ab8b00c-7088-4b75-b426-c21fce55982b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:59.816583 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6ab8b00c-7088-4b75-b426-c21fce55982b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:37:59.817148 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6ab8b00c-7088-4b75-b426-c21fce55982b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:37:59.817632 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6ab8b00c-7088-4b75-b426-c21fce55982b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:37:59.903071 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-6ab8b00c-7088-4b75-b426-c21fce55982b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8cd3b906-abcb-4669-9d1b-0dd3133ec23e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.105930 Aug 06 14:37:59.903662 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 474/899] 10.222.0.17 () {58 vars in 1275 bytes} [Sat Aug 6 14:37:59 2022] GET /compute/v2.1/servers/8cd3b906-abcb-4669-9d1b-0dd3133ec23e/os-interface => generated 284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:38:00.071756 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-dae11f45-4b4b-49e4-b87f-2611d10e962d tempest-VolumesGetTestJSON-1685278193 tempest-VolumesGetTestJSON-1685278193-project] Action: 'create', calling method: .version_select at 0x7fbab135c9d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1176992709", "metadata": {"Type": "work"}}} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:38:00.387435 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-dae11f45-4b4b-49e4-b87f-2611d10e962d tempest-VolumesGetTestJSON-1685278193 tempest-VolumesGetTestJSON-1685278193-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.504522 Aug 06 14:38:00.395620 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 426/900] 10.222.0.17 () {60 vars in 1156 bytes} [Sat Aug 6 14:37:59 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 506 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 06 14:38:00.400886 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-9717a810-d580-4742-b0a0-f81299ec9978 tempest-VolumesGetTestJSON-1685278193 tempest-VolumesGetTestJSON-1685278193-project] Calling method '.version_select at 0x7fbab0cf2040>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:38:00.453129 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-9717a810-d580-4742-b0a0-f81299ec9978 tempest-VolumesGetTestJSON-1685278193 tempest-VolumesGetTestJSON-1685278193-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/c21555fe-c81a-488a-9a5d-2294afe904f6" status: 200 len: 353 microversion: 2.1 time: 0.056085 Aug 06 14:38:00.453702 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 475/901] 10.222.0.17 () {58 vars in 1245 bytes} [Sat Aug 6 14:38:00 2022] GET /compute/v2.1/os-volumes/c21555fe-c81a-488a-9a5d-2294afe904f6 => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:38:01.114272 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [req-ae885d92-c2ae-4585-808e-5aa51d2d4507 req-05364d49-56ef-46b2-9900-c14959b3cdf9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cd3b906-abcb-4669-9d1b-0dd3133ec23e", "tag": "1dfff01d-0a08-4442-88d9-0edaf57e0f1a"}]} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:38:01.125230 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-ae885d92-c2ae-4585-808e-5aa51d2d4507 req-05364d49-56ef-46b2-9900-c14959b3cdf9 service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:01.125782 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-ae885d92-c2ae-4585-808e-5aa51d2d4507 req-05364d49-56ef-46b2-9900-c14959b3cdf9 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:01.126280 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-ae885d92-c2ae-4585-808e-5aa51d2d4507 req-05364d49-56ef-46b2-9900-c14959b3cdf9 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:01.136441 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.compute.server_external_events [req-ae885d92-c2ae-4585-808e-5aa51d2d4507 req-05364d49-56ef-46b2-9900-c14959b3cdf9 service nova] Creating event network-changed:1dfff01d-0a08-4442-88d9-0edaf57e0f1a for instance 8cd3b906-abcb-4669-9d1b-0dd3133ec23e on hv-cinder-85199 Aug 06 14:38:01.141379 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [req-ae885d92-c2ae-4585-808e-5aa51d2d4507 req-05364d49-56ef-46b2-9900-c14959b3cdf9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031354 Aug 06 14:38:01.141956 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 427/902] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:38:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:38:01.469574 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-35164433-f493-4138-a601-c40eead5e244 tempest-VolumesGetTestJSON-1685278193 tempest-VolumesGetTestJSON-1685278193-project] Calling method '.version_select at 0x7fbab0ca93a0>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:38:01.519400 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-35164433-f493-4138-a601-c40eead5e244 tempest-VolumesGetTestJSON-1685278193 tempest-VolumesGetTestJSON-1685278193-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/c21555fe-c81a-488a-9a5d-2294afe904f6" status: 200 len: 354 microversion: 2.1 time: 0.054552 Aug 06 14:38:01.520511 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 476/903] 10.222.0.17 () {58 vars in 1245 bytes} [Sat Aug 6 14:38:01 2022] GET /compute/v2.1/os-volumes/c21555fe-c81a-488a-9a5d-2294afe904f6 => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:38:01.533333 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-4bfa5728-43b1-4561-886e-2d77fdf57a23 tempest-VolumesGetTestJSON-1685278193 tempest-VolumesGetTestJSON-1685278193-project] Calling method '.version_select at 0x7fbab136e940>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:38:01.582115 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-4bfa5728-43b1-4561-886e-2d77fdf57a23 tempest-VolumesGetTestJSON-1685278193 tempest-VolumesGetTestJSON-1685278193-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/c21555fe-c81a-488a-9a5d-2294afe904f6" status: 200 len: 354 microversion: 2.1 time: 0.053434 Aug 06 14:38:01.582681 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 428/904] 10.222.0.17 () {58 vars in 1245 bytes} [Sat Aug 6 14:38:01 2022] GET /compute/v2.1/os-volumes/c21555fe-c81a-488a-9a5d-2294afe904f6 => generated 354 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:38:01.600221 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-4a4fc7d8-c153-4030-8526-da4d8a75e399 tempest-VolumesGetTestJSON-1685278193 tempest-VolumesGetTestJSON-1685278193-project] Calling method '.version_select at 0x7fbab0cfac10>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:38:01.669457 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-4a4fc7d8-c153-4030-8526-da4d8a75e399 tempest-VolumesGetTestJSON-1685278193 tempest-VolumesGetTestJSON-1685278193-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/c21555fe-c81a-488a-9a5d-2294afe904f6" status: 202 len: 0 microversion: 2.1 time: 0.072963 Aug 06 14:38:01.671164 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 477/905] 10.222.0.17 () {58 vars in 1248 bytes} [Sat Aug 6 14:38:01 2022] DELETE /compute/v2.1/os-volumes/c21555fe-c81a-488a-9a5d-2294afe904f6 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 14:38:01.679597 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-4716d650-1a0e-460e-9878-318557d13e50 tempest-VolumesGetTestJSON-1685278193 tempest-VolumesGetTestJSON-1685278193-project] Calling method '.version_select at 0x7fbab135c670>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:38:01.741350 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-4716d650-1a0e-460e-9878-318557d13e50 tempest-VolumesGetTestJSON-1685278193 tempest-VolumesGetTestJSON-1685278193-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/c21555fe-c81a-488a-9a5d-2294afe904f6" status: 200 len: 353 microversion: 2.1 time: 0.065935 Aug 06 14:38:01.741917 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 429/906] 10.222.0.17 () {58 vars in 1245 bytes} [Sat Aug 6 14:38:01 2022] GET /compute/v2.1/os-volumes/c21555fe-c81a-488a-9a5d-2294afe904f6 => generated 353 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:38:02.756559 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-ddbbbcb1-e945-4ed7-a1c8-0c7a86462845 tempest-VolumesGetTestJSON-1685278193 tempest-VolumesGetTestJSON-1685278193-project] Calling method '.version_select at 0x7fbab0cf29d0>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:38:02.784025 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.wsgi [None req-ddbbbcb1-e945-4ed7-a1c8-0c7a86462845 tempest-VolumesGetTestJSON-1685278193 tempest-VolumesGetTestJSON-1685278193-project] HTTP exception thrown: Volume c21555fe-c81a-488a-9a5d-2294afe904f6 could not be found. Aug 06 14:38:02.786120 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-ddbbbcb1-e945-4ed7-a1c8-0c7a86462845 tempest-VolumesGetTestJSON-1685278193 tempest-VolumesGetTestJSON-1685278193-project] Request method failure captured: Aug 06 14:38:02.786120 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: request: GET /compute/v2.1/os-volumes/c21555fe-c81a-488a-9a5d-2294afe904f6 HTTP/1.1 Aug 06 14:38:02.786120 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Accept: application/json Aug 06 14:38:02.786120 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Accept-Encoding: identity Aug 06 14:38:02.786120 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Connection: close Aug 06 14:38:02.786120 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Content-Length: 0 Aug 06 14:38:02.786120 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Content-Type: application/json Aug 06 14:38:02.786120 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Host: 10.222.0.17 Aug 06 14:38:02.786120 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Openstack-System-Scope: None Aug 06 14:38:02.786120 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: User-Agent: python-urllib3/1.26.11 Aug 06 14:38:02.786120 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Auth-Token: gAAAAABi7nzHwcVHaDoZrzOX5QImYAo7zTxMzY9zeFV3DHz-3BwNHD6MN_MdF5ZX7DrJrCsV5z6diRr3pUy_PnP96lSRwgOC_yosNyNF9Z339h3ttLHgJQmhqYn955atuTzVDGc4B3NPuGGD7DZifBu04UAIAhpqw59wdRBkNbUJuoubDJm93ZE Aug 06 14:38:02.786120 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Domain-Id: None Aug 06 14:38:02.786120 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Domain-Name: None Aug 06 14:38:02.786120 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Identity-Status: Confirmed Aug 06 14:38:02.786120 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Is-Admin-Project: True Aug 06 14:38:02.786120 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Domain-Id: default Aug 06 14:38:02.786120 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Domain-Name: Default Aug 06 14:38:02.786120 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Id: 6dd1029bfa7c4713b52e5d63a65ac3ec Aug 06 14:38:02.786120 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Name: tempest-VolumesGetTestJSON-1685278193 Aug 06 14:38:02.786120 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Role: member,reader Aug 06 14:38:02.786120 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Roles: member,reader Aug 06 14:38:02.787739 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6dd1029bfa7c4713b52e5d63a65ac3ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6dd1029bfa7c4713b52e5d63a65ac3ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6dd1029bfa7c4713b52e5d63a65ac3ec", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6dd1029bfa7c4713b52e5d63a65ac3ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 06 14:38:02.787739 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant: tempest-VolumesGetTestJSON-1685278193 Aug 06 14:38:02.787739 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant-Id: 6dd1029bfa7c4713b52e5d63a65ac3ec Aug 06 14:38:02.787739 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant-Name: tempest-VolumesGetTestJSON-1685278193 Aug 06 14:38:02.787739 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User: tempest-VolumesGetTestJSON-1685278193-project Aug 06 14:38:02.787739 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Domain-Id: default Aug 06 14:38:02.787739 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Domain-Name: Default Aug 06 14:38:02.787739 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Id: b63ee5fe10bd43e9a4fe388a02612786 Aug 06 14:38:02.787739 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Name: tempest-VolumesGetTestJSON-1685278193-project Aug 06 14:38:02.787739 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: method: Aug 06 14:38:02.787739 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: exception: Volume c21555fe-c81a-488a-9a5d-2294afe904f6 could not be found. Aug 06 14:38:02.787739 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: action_args: {'id': 'c21555fe-c81a-488a-9a5d-2294afe904f6'} Aug 06 14:38:02.787739 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 14:38:02.788711 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:38:02.788711 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 14:38:02.788711 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 14:38:02.788711 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 06 14:38:02.788711 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 06 14:38:02.788711 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 06 14:38:02.788711 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 06 14:38:02.788711 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 06 14:38:02.788711 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 06 14:38:02.788711 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 06 14:38:02.788711 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 06 14:38:02.788711 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 14:38:02.788711 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 14:38:02.788711 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 14:38:02.788711 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 14:38:02.788711 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c21555fe-c81a-488a-9a5d-2294afe904f6 could not be found. (HTTP 404) (Request-ID: req-31131c74-0516-4b31-a7c0-e36501354a21) Aug 06 14:38:02.788711 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:38:02.788711 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:38:02.788711 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:38:02.790137 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:38:02.790137 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 06 14:38:02.790137 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 06 14:38:02.790137 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 06 14:38:02.790137 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 06 14:38:02.790137 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 06 14:38:02.790137 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 06 14:38:02.790137 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 06 14:38:02.790137 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 06 14:38:02.790137 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 06 14:38:02.790137 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 06 14:38:02.790137 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 06 14:38:02.790137 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 06 14:38:02.790137 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 06 14:38:02.790137 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 06 14:38:02.790137 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 06 14:38:02.790137 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 06 14:38:02.790137 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 06 14:38:02.790137 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 06 14:38:02.791547 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 06 14:38:02.791547 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 06 14:38:02.791547 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 06 14:38:02.791547 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 06 14:38:02.791547 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c21555fe-c81a-488a-9a5d-2294afe904f6 could not be found. Aug 06 14:38:02.791547 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:38:02.791547 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:38:02.791547 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:38:02.791547 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:38:02.791547 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:38:02.791547 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:38:02.791547 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 14:38:02.791547 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 14:38:02.791547 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 06 14:38:02.791547 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 06 14:38:02.791547 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 14:38:02.791547 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 14:38:02.791547 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 06 14:38:02.791547 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 14:38:02.792929 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c21555fe-c81a-488a-9a5d-2294afe904f6 could not be found. Aug 06 14:38:02.792929 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:38:02.792929 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:38:02.792929 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:38:02.792929 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:38:02.792929 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:38:02.792929 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:38:02.792929 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 14:38:02.792929 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 14:38:02.792929 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c21555fe-c81a-488a-9a5d-2294afe904f6 could not be found. Aug 06 14:38:02.792929 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:38:02.792929 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-ddbbbcb1-e945-4ed7-a1c8-0c7a86462845 tempest-VolumesGetTestJSON-1685278193 tempest-VolumesGetTestJSON-1685278193-project] Returning 404 to user: Volume c21555fe-c81a-488a-9a5d-2294afe904f6 could not be found. {{(pid=117837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 14:38:02.792929 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-ddbbbcb1-e945-4ed7-a1c8-0c7a86462845 tempest-VolumesGetTestJSON-1685278193 tempest-VolumesGetTestJSON-1685278193-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/c21555fe-c81a-488a-9a5d-2294afe904f6" status: 404 len: 109 microversion: 2.1 time: 0.036211 Aug 06 14:38:02.792929 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 478/907] 10.222.0.17 () {58 vars in 1245 bytes} [Sat Aug 6 14:38:02 2022] GET /compute/v2.1/os-volumes/c21555fe-c81a-488a-9a5d-2294afe904f6 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 14:38:27.795941 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_api:SELECT=74,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:38:27.796733 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:38:27.800587 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-55d03c04-cee3-432d-9bd0-113e2cda6e8f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:38:27.801166 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-55d03c04-cee3-432d-9bd0-113e2cda6e8f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6d80056a-5ade-4f3b-8e08-adf707c34cfe] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:38:27.809266 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-55d03c04-cee3-432d-9bd0-113e2cda6e8f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:27.809741 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-55d03c04-cee3-432d-9bd0-113e2cda6e8f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:27.810168 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-55d03c04-cee3-432d-9bd0-113e2cda6e8f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:27.810848 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-55d03c04-cee3-432d-9bd0-113e2cda6e8f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:27.811815 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-55d03c04-cee3-432d-9bd0-113e2cda6e8f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:27.812236 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-55d03c04-cee3-432d-9bd0-113e2cda6e8f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:27.836246 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-55d03c04-cee3-432d-9bd0-113e2cda6e8f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/6d80056a-5ade-4f3b-8e08-adf707c34cfe/ips" status: 200 len: 148 microversion: 2.1 time: 0.041830 Aug 06 14:38:27.836811 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 430/908] 10.222.0.17 () {58 vars in 1248 bytes} [Sat Aug 6 14:38:27 2022] GET /compute/v2.1/servers/6d80056a-5ade-4f3b-8e08-adf707c34cfe/ips => generated 148 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:38:29.161896 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:38:29.162689 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_cell1:SELECT=22 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:38:29.167935 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-2ce3114e-1eb6-402f-936f-69f09ce6c37d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "347d5b31-ebdc-42c4-9582-17c83906b0a1"}} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:38:29.170428 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-2ce3114e-1eb6-402f-936f-69f09ce6c37d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6d80056a-5ade-4f3b-8e08-adf707c34cfe] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:38:29.177626 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2ce3114e-1eb6-402f-936f-69f09ce6c37d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:29.178226 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2ce3114e-1eb6-402f-936f-69f09ce6c37d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:29.178686 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2ce3114e-1eb6-402f-936f-69f09ce6c37d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:29.179369 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2ce3114e-1eb6-402f-936f-69f09ce6c37d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:29.179817 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2ce3114e-1eb6-402f-936f-69f09ce6c37d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:29.180235 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2ce3114e-1eb6-402f-936f-69f09ce6c37d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:29.442739 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-2ce3114e-1eb6-402f-936f-69f09ce6c37d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "POST /compute/v2.1/servers/6d80056a-5ade-4f3b-8e08-adf707c34cfe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281895 Aug 06 14:38:29.443607 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 479/909] 10.222.0.17 () {60 vars in 1323 bytes} [Sat Aug 6 14:38:29 2022] POST /compute/v2.1/servers/6d80056a-5ade-4f3b-8e08-adf707c34cfe/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:38:30.817089 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-a9e4dce1-5e36-4eaf-8b0e-047da87b2076 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:38:30.817651 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-a9e4dce1-5e36-4eaf-8b0e-047da87b2076 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:38:30.824228 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a9e4dce1-5e36-4eaf-8b0e-047da87b2076 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:30.824778 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a9e4dce1-5e36-4eaf-8b0e-047da87b2076 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:30.825273 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a9e4dce1-5e36-4eaf-8b0e-047da87b2076 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:30.826068 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a9e4dce1-5e36-4eaf-8b0e-047da87b2076 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:30.826525 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a9e4dce1-5e36-4eaf-8b0e-047da87b2076 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:30.827546 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a9e4dce1-5e36-4eaf-8b0e-047da87b2076 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:30.850145 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-a9e4dce1-5e36-4eaf-8b0e-047da87b2076 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e/ips" status: 200 len: 152 microversion: 2.20 time: 0.037369 Aug 06 14:38:30.850747 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 431/910] 10.222.0.17 () {60 vars in 1289 bytes} [Sat Aug 6 14:38:30 2022] GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e/ips => generated 152 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 14:38:32.639750 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-260d1003-91ce-4a2e-98d3-f66c121be06e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:38:32.640371 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-260d1003-91ce-4a2e-98d3-f66c121be06e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:38:32.646892 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-260d1003-91ce-4a2e-98d3-f66c121be06e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:32.647377 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-260d1003-91ce-4a2e-98d3-f66c121be06e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:32.647810 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-260d1003-91ce-4a2e-98d3-f66c121be06e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:32.648500 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-260d1003-91ce-4a2e-98d3-f66c121be06e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:32.648948 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-260d1003-91ce-4a2e-98d3-f66c121be06e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:32.649370 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-260d1003-91ce-4a2e-98d3-f66c121be06e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:32.671755 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.objects.instance [None req-260d1003-91ce-4a2e-98d3-f66c121be06e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lazy-loading 'flavor' on Instance uuid 91e50552-3108-4fca-82ca-e299af40061e {{(pid=117837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 14:38:32.844387 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-260d1003-91ce-4a2e-98d3-f66c121be06e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "POST /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e/action" status: 202 len: 0 microversion: 2.20 time: 0.208454 Aug 06 14:38:32.844979 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 480/911] 10.222.0.17 () {62 vars in 1319 bytes} [Sat Aug 6 14:38:32 2022] POST /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 06 14:38:32.853732 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-250c2d8f-b732-4ae3-8d1c-913e0a27b75c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:38:32.854337 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-250c2d8f-b732-4ae3-8d1c-913e0a27b75c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:38:32.861456 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-250c2d8f-b732-4ae3-8d1c-913e0a27b75c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:32.862074 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-250c2d8f-b732-4ae3-8d1c-913e0a27b75c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:32.862617 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-250c2d8f-b732-4ae3-8d1c-913e0a27b75c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:32.863418 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-250c2d8f-b732-4ae3-8d1c-913e0a27b75c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:32.863866 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-250c2d8f-b732-4ae3-8d1c-913e0a27b75c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:32.864285 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-250c2d8f-b732-4ae3-8d1c-913e0a27b75c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:33.002962 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-250c2d8f-b732-4ae3-8d1c-913e0a27b75c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:33.011517 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-250c2d8f-b732-4ae3-8d1c-913e0a27b75c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:33.013071 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-250c2d8f-b732-4ae3-8d1c-913e0a27b75c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:33.014297 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-250c2d8f-b732-4ae3-8d1c-913e0a27b75c tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e" status: 200 len: 1725 microversion: 2.20 time: 0.164542 Aug 06 14:38:33.014835 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 432/912] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:38:32 2022] GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:38:34.039089 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-edb80e23-58d9-42a8-87f7-00bf3c4884e8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:38:34.039721 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-edb80e23-58d9-42a8-87f7-00bf3c4884e8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:38:34.047153 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-edb80e23-58d9-42a8-87f7-00bf3c4884e8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:34.047635 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-edb80e23-58d9-42a8-87f7-00bf3c4884e8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:34.048069 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-edb80e23-58d9-42a8-87f7-00bf3c4884e8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:34.048755 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-edb80e23-58d9-42a8-87f7-00bf3c4884e8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:34.049209 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-edb80e23-58d9-42a8-87f7-00bf3c4884e8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:34.049634 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-edb80e23-58d9-42a8-87f7-00bf3c4884e8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:34.176522 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-edb80e23-58d9-42a8-87f7-00bf3c4884e8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:34.185293 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-edb80e23-58d9-42a8-87f7-00bf3c4884e8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:34.187320 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-edb80e23-58d9-42a8-87f7-00bf3c4884e8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:34.188517 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-edb80e23-58d9-42a8-87f7-00bf3c4884e8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e" status: 200 len: 1725 microversion: 2.20 time: 0.154369 Aug 06 14:38:34.189056 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 481/913] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:38:34 2022] GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:38:35.211428 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-3b9d93d2-8135-4007-a13e-c7ec0dc156a3 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:38:35.212037 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-3b9d93d2-8135-4007-a13e-c7ec0dc156a3 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:38:35.218875 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3b9d93d2-8135-4007-a13e-c7ec0dc156a3 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:35.219358 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3b9d93d2-8135-4007-a13e-c7ec0dc156a3 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:35.219790 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3b9d93d2-8135-4007-a13e-c7ec0dc156a3 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:35.220477 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3b9d93d2-8135-4007-a13e-c7ec0dc156a3 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:35.220929 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3b9d93d2-8135-4007-a13e-c7ec0dc156a3 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:35.221348 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3b9d93d2-8135-4007-a13e-c7ec0dc156a3 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:35.355192 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-3b9d93d2-8135-4007-a13e-c7ec0dc156a3 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:35.362948 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-3b9d93d2-8135-4007-a13e-c7ec0dc156a3 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:35.364431 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-3b9d93d2-8135-4007-a13e-c7ec0dc156a3 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:35.365578 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-3b9d93d2-8135-4007-a13e-c7ec0dc156a3 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e" status: 200 len: 1725 microversion: 2.20 time: 0.158131 Aug 06 14:38:35.366127 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 433/914] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:38:35 2022] GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:38:36.389584 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-f19efe42-9428-4279-805a-89699d755915 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:38:36.390305 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-f19efe42-9428-4279-805a-89699d755915 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:38:36.396707 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f19efe42-9428-4279-805a-89699d755915 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:36.397184 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f19efe42-9428-4279-805a-89699d755915 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:36.397618 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f19efe42-9428-4279-805a-89699d755915 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:36.398303 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f19efe42-9428-4279-805a-89699d755915 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:36.398756 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f19efe42-9428-4279-805a-89699d755915 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:36.399202 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f19efe42-9428-4279-805a-89699d755915 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:36.525016 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-f19efe42-9428-4279-805a-89699d755915 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:36.533422 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-f19efe42-9428-4279-805a-89699d755915 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:36.534942 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-f19efe42-9428-4279-805a-89699d755915 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:36.536088 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-f19efe42-9428-4279-805a-89699d755915 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e" status: 200 len: 1725 microversion: 2.20 time: 0.151025 Aug 06 14:38:36.536641 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 482/915] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:38:36 2022] GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:38:36.967766 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-29670181-83a8-44f3-a31e-e6cc889d0cdf tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "347d5b31-ebdc-42c4-9582-17c83906b0a1"}} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:38:36.970161 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-29670181-83a8-44f3-a31e-e6cc889d0cdf tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6d80056a-5ade-4f3b-8e08-adf707c34cfe] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:38:36.976485 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-29670181-83a8-44f3-a31e-e6cc889d0cdf tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:36.976967 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-29670181-83a8-44f3-a31e-e6cc889d0cdf tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:36.977407 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-29670181-83a8-44f3-a31e-e6cc889d0cdf tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:36.978092 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-29670181-83a8-44f3-a31e-e6cc889d0cdf tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:36.978545 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-29670181-83a8-44f3-a31e-e6cc889d0cdf tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:36.978998 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-29670181-83a8-44f3-a31e-e6cc889d0cdf tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:37.057510 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.wsgi [None req-29670181-83a8-44f3-a31e-e6cc889d0cdf tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] HTTP exception thrown: Invalid volume: volume 347d5b31-ebdc-42c4-9582-17c83906b0a1 is already attached to instances: 6d80056a-5ade-4f3b-8e08-adf707c34cfe Aug 06 14:38:37.059514 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-29670181-83a8-44f3-a31e-e6cc889d0cdf tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Request method failure captured: Aug 06 14:38:37.059514 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: request: POST /compute/v2.1/servers/6d80056a-5ade-4f3b-8e08-adf707c34cfe/os-volume_attachments HTTP/1.1 Aug 06 14:38:37.059514 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Accept: application/json Aug 06 14:38:37.059514 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Accept-Encoding: identity Aug 06 14:38:37.059514 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Connection: close Aug 06 14:38:37.059514 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Content-Length: 74 Aug 06 14:38:37.059514 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Content-Type: application/json Aug 06 14:38:37.059514 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Host: 10.222.0.17 Aug 06 14:38:37.059514 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Openstack-System-Scope: None Aug 06 14:38:37.059514 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: User-Agent: python-urllib3/1.26.11 Aug 06 14:38:37.059514 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Auth-Token: gAAAAABi7nrw1j_Ge2Ur2tEojXwBmjEDUihl-N8v1g20aSIVDaeL_OTgCZQS1IFihI0AmtEC1h-SgLRiudvycNkR7KjoTpqo7M5425d9Dy_4zXKbCfizwmIbraJL9PsVC3rQgInSWh6L4pF_pLJlUkvGCOVZ6ElDrY4gMQsJ7uwAoVwYy3EWJq0 Aug 06 14:38:37.059514 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Domain-Id: None Aug 06 14:38:37.059514 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Domain-Name: None Aug 06 14:38:37.059514 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Identity-Status: Confirmed Aug 06 14:38:37.059514 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Is-Admin-Project: True Aug 06 14:38:37.059514 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Domain-Id: default Aug 06 14:38:37.059514 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Domain-Name: Default Aug 06 14:38:37.059514 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Id: 96a7bb12d3ed4d1db2a58a03472483c2 Aug 06 14:38:37.059514 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Name: tempest-AttachVolumeNegativeTest-927490997 Aug 06 14:38:37.059514 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Role: member,reader Aug 06 14:38:37.059514 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Roles: member,reader Aug 06 14:38:37.061746 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/96a7bb12d3ed4d1db2a58a03472483c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/96a7bb12d3ed4d1db2a58a03472483c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_96a7bb12d3ed4d1db2a58a03472483c2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/96a7bb12d3ed4d1db2a58a03472483c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 06 14:38:37.061746 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Tenant: tempest-AttachVolumeNegativeTest-927490997 Aug 06 14:38:37.061746 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Tenant-Id: 96a7bb12d3ed4d1db2a58a03472483c2 Aug 06 14:38:37.061746 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-927490997 Aug 06 14:38:37.061746 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User: tempest-AttachVolumeNegativeTest-927490997-project Aug 06 14:38:37.061746 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Domain-Id: default Aug 06 14:38:37.061746 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Domain-Name: Default Aug 06 14:38:37.061746 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Id: 5378c85cd31c42dfbc39ce738a8b6dde Aug 06 14:38:37.061746 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Name: tempest-AttachVolumeNegativeTest-927490997-project Aug 06 14:38:37.061746 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Aug 06 14:38:37.061746 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: {"volumeAttachment": {"volumeId": "347d5b31-ebdc-42c4-9582-17c83906b0a1"}} Aug 06 14:38:37.061746 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: method: > Aug 06 14:38:37.062561 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: exception: Invalid volume: volume 347d5b31-ebdc-42c4-9582-17c83906b0a1 is already attached to instances: 6d80056a-5ade-4f3b-8e08-adf707c34cfe Aug 06 14:38:37.062561 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: action_args: {'server_id': '6d80056a-5ade-4f3b-8e08-adf707c34cfe', 'body': {'volumeAttachment': {'volumeId': '347d5b31-ebdc-42c4-9582-17c83906b0a1'}}} Aug 06 14:38:37.062561 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 14:38:37.062561 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:38:37.062561 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 06 14:38:37.062561 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 06 14:38:37.062561 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 06 14:38:37.062561 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 06 14:38:37.062561 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 06 14:38:37.062561 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 06 14:38:37.062561 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 06 14:38:37.062561 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 06 14:38:37.062561 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 06 14:38:37.062561 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 06 14:38:37.062561 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 347d5b31-ebdc-42c4-9582-17c83906b0a1 is already attached to instances: 6d80056a-5ade-4f3b-8e08-adf707c34cfe Aug 06 14:38:37.062561 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:38:37.062561 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:38:37.062561 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:38:37.062561 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:38:37.063971 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:38:37.063971 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:38:37.063971 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 14:38:37.063971 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 14:38:37.063971 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 14:38:37.063971 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 14:38:37.063971 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 14:38:37.063971 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 14:38:37.063971 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 14:38:37.063971 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 14:38:37.063971 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 06 14:38:37.063971 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 06 14:38:37.063971 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 06 14:38:37.063971 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 06 14:38:37.063971 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 347d5b31-ebdc-42c4-9582-17c83906b0a1 is already attached to instances: 6d80056a-5ade-4f3b-8e08-adf707c34cfe Aug 06 14:38:37.063971 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:38:37.063971 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:38:37.063971 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:38:37.063971 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:38:37.063971 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:38:37.065491 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:38:37.065491 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 14:38:37.065491 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 14:38:37.065491 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 347d5b31-ebdc-42c4-9582-17c83906b0a1 is already attached to instances: 6d80056a-5ade-4f3b-8e08-adf707c34cfe Aug 06 14:38:37.065491 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:38:37.065491 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-29670181-83a8-44f3-a31e-e6cc889d0cdf tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Returning 400 to user: Invalid volume: volume 347d5b31-ebdc-42c4-9582-17c83906b0a1 is already attached to instances: 6d80056a-5ade-4f3b-8e08-adf707c34cfe {{(pid=117838) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 14:38:37.065491 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-29670181-83a8-44f3-a31e-e6cc889d0cdf tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "POST /compute/v2.1/servers/6d80056a-5ade-4f3b-8e08-adf707c34cfe/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097194 Aug 06 14:38:37.065491 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 434/916] 10.222.0.17 () {60 vars in 1323 bytes} [Sat Aug 6 14:38:36 2022] POST /compute/v2.1/servers/6d80056a-5ade-4f3b-8e08-adf707c34cfe/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 06 14:38:37.126850 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-1b37d033-20c1-4761-9264-6438f7c0ac6a tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:38:37.127404 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-1b37d033-20c1-4761-9264-6438f7c0ac6a tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6d80056a-5ade-4f3b-8e08-adf707c34cfe] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:38:37.133202 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1b37d033-20c1-4761-9264-6438f7c0ac6a tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:37.133676 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1b37d033-20c1-4761-9264-6438f7c0ac6a tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:37.134112 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1b37d033-20c1-4761-9264-6438f7c0ac6a tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:37.134807 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1b37d033-20c1-4761-9264-6438f7c0ac6a tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:37.135289 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1b37d033-20c1-4761-9264-6438f7c0ac6a tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:37.135721 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1b37d033-20c1-4761-9264-6438f7c0ac6a tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:37.215479 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.objects.instance [None req-1b37d033-20c1-4761-9264-6438f7c0ac6a tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lazy-loading 'services' on Instance uuid 6d80056a-5ade-4f3b-8e08-adf707c34cfe {{(pid=117837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 14:38:37.287789 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-1b37d033-20c1-4761-9264-6438f7c0ac6a tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "DELETE /compute/v2.1/servers/6d80056a-5ade-4f3b-8e08-adf707c34cfe/os-volume_attachments/347d5b31-ebdc-42c4-9582-17c83906b0a1" status: 202 len: 0 microversion: 2.1 time: 0.165308 Aug 06 14:38:37.288362 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 483/917] 10.222.0.17 () {58 vars in 1416 bytes} [Sat Aug 6 14:38:37 2022] DELETE /compute/v2.1/servers/6d80056a-5ade-4f3b-8e08-adf707c34cfe/os-volume_attachments/347d5b31-ebdc-42c4-9582-17c83906b0a1 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 14:38:37.297550 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-405fca0a-df64-418a-9a4d-1093bc511b5d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:38:37.299855 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-405fca0a-df64-418a-9a4d-1093bc511b5d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6d80056a-5ade-4f3b-8e08-adf707c34cfe] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:38:37.306860 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-405fca0a-df64-418a-9a4d-1093bc511b5d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:37.307762 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-405fca0a-df64-418a-9a4d-1093bc511b5d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:37.308317 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-405fca0a-df64-418a-9a4d-1093bc511b5d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:37.309179 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-405fca0a-df64-418a-9a4d-1093bc511b5d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:37.309631 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-405fca0a-df64-418a-9a4d-1093bc511b5d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:37.310222 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-405fca0a-df64-418a-9a4d-1093bc511b5d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:37.340175 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-405fca0a-df64-418a-9a4d-1093bc511b5d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/6d80056a-5ade-4f3b-8e08-adf707c34cfe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047217 Aug 06 14:38:37.340744 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 435/918] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Aug 6 14:38:37 2022] GET /compute/v2.1/servers/6d80056a-5ade-4f3b-8e08-adf707c34cfe/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 14:38:37.559971 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-3cb34f20-68fa-4d5b-bd21-7ac6be511736 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:38:37.560661 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-3cb34f20-68fa-4d5b-bd21-7ac6be511736 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:38:37.567239 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-3cb34f20-68fa-4d5b-bd21-7ac6be511736 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:37.567719 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-3cb34f20-68fa-4d5b-bd21-7ac6be511736 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:37.568148 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-3cb34f20-68fa-4d5b-bd21-7ac6be511736 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:37.568841 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-3cb34f20-68fa-4d5b-bd21-7ac6be511736 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:37.569285 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-3cb34f20-68fa-4d5b-bd21-7ac6be511736 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:37.569695 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-3cb34f20-68fa-4d5b-bd21-7ac6be511736 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:37.735435 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-3cb34f20-68fa-4d5b-bd21-7ac6be511736 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:37.744036 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-3cb34f20-68fa-4d5b-bd21-7ac6be511736 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:37.745610 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-3cb34f20-68fa-4d5b-bd21-7ac6be511736 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:37.746895 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-3cb34f20-68fa-4d5b-bd21-7ac6be511736 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e" status: 200 len: 1725 microversion: 2.20 time: 0.191767 Aug 06 14:38:37.747547 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 484/919] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:38:37 2022] GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e => generated 1725 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:38:38.352932 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-1568c05c-628c-4aab-8556-f934c1eac6cf tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:38:38.355205 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-1568c05c-628c-4aab-8556-f934c1eac6cf tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6d80056a-5ade-4f3b-8e08-adf707c34cfe] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:38:38.361882 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1568c05c-628c-4aab-8556-f934c1eac6cf tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:38.362302 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1568c05c-628c-4aab-8556-f934c1eac6cf tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:38.363377 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1568c05c-628c-4aab-8556-f934c1eac6cf tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:38.364102 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1568c05c-628c-4aab-8556-f934c1eac6cf tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:38.364564 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1568c05c-628c-4aab-8556-f934c1eac6cf tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:38.364983 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1568c05c-628c-4aab-8556-f934c1eac6cf tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:38.396920 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-1568c05c-628c-4aab-8556-f934c1eac6cf tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/6d80056a-5ade-4f3b-8e08-adf707c34cfe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048161 Aug 06 14:38:38.397479 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 436/920] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Aug 6 14:38:38 2022] GET /compute/v2.1/servers/6d80056a-5ade-4f3b-8e08-adf707c34cfe/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 06 14:38:38.459212 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-26cf2494-dbea-425e-8804-2f497b8a4202 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:38:38.459711 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-26cf2494-dbea-425e-8804-2f497b8a4202 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6d80056a-5ade-4f3b-8e08-adf707c34cfe] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:38:38.465582 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-26cf2494-dbea-425e-8804-2f497b8a4202 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:38.466058 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-26cf2494-dbea-425e-8804-2f497b8a4202 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:38.466489 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-26cf2494-dbea-425e-8804-2f497b8a4202 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:38.467201 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-26cf2494-dbea-425e-8804-2f497b8a4202 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:38.467652 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-26cf2494-dbea-425e-8804-2f497b8a4202 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:38.468091 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-26cf2494-dbea-425e-8804-2f497b8a4202 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:38.495091 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-26cf2494-dbea-425e-8804-2f497b8a4202 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6d80056a-5ade-4f3b-8e08-adf707c34cfe] Going to try to terminate instance {{(pid=117837) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 14:38:38.724024 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-26cf2494-dbea-425e-8804-2f497b8a4202 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "DELETE /compute/v2.1/servers/6d80056a-5ade-4f3b-8e08-adf707c34cfe" status: 204 len: 0 microversion: 2.1 time: 0.268220 Aug 06 14:38:38.725022 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 485/921] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Aug 6 14:38:38 2022] DELETE /compute/v2.1/servers/6d80056a-5ade-4f3b-8e08-adf707c34cfe => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 14:38:38.734120 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-39fde12f-cd9f-49cd-9145-d2fa1ad034e6 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:38:38.734755 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-39fde12f-cd9f-49cd-9145-d2fa1ad034e6 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6d80056a-5ade-4f3b-8e08-adf707c34cfe] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:38:38.741432 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-39fde12f-cd9f-49cd-9145-d2fa1ad034e6 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:38.741916 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-39fde12f-cd9f-49cd-9145-d2fa1ad034e6 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:38.742354 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-39fde12f-cd9f-49cd-9145-d2fa1ad034e6 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:38.743170 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-39fde12f-cd9f-49cd-9145-d2fa1ad034e6 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:38.743635 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-39fde12f-cd9f-49cd-9145-d2fa1ad034e6 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:38.744056 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-39fde12f-cd9f-49cd-9145-d2fa1ad034e6 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:38.769921 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-5ea0c964-9eb4-43b9-9ddb-4859a4fbb144 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:38:38.770620 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-5ea0c964-9eb4-43b9-9ddb-4859a4fbb144 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:38:38.776480 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-5ea0c964-9eb4-43b9-9ddb-4859a4fbb144 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:38.776961 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-5ea0c964-9eb4-43b9-9ddb-4859a4fbb144 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:38.777584 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-5ea0c964-9eb4-43b9-9ddb-4859a4fbb144 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:38.778286 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-5ea0c964-9eb4-43b9-9ddb-4859a4fbb144 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:38.778732 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-5ea0c964-9eb4-43b9-9ddb-4859a4fbb144 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:38.779370 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-5ea0c964-9eb4-43b9-9ddb-4859a4fbb144 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:38.895384 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-39fde12f-cd9f-49cd-9145-d2fa1ad034e6 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:38.903089 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-39fde12f-cd9f-49cd-9145-d2fa1ad034e6 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/6d80056a-5ade-4f3b-8e08-adf707c34cfe" status: 200 len: 1681 microversion: 2.1 time: 0.173616 Aug 06 14:38:38.917500 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 437/922] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:38:38 2022] GET /compute/v2.1/servers/6d80056a-5ade-4f3b-8e08-adf707c34cfe => generated 1681 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:38:38.926395 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-5ea0c964-9eb4-43b9-9ddb-4859a4fbb144 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:38.935105 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-5ea0c964-9eb4-43b9-9ddb-4859a4fbb144 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:38.937026 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-5ea0c964-9eb4-43b9-9ddb-4859a4fbb144 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:38.938287 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-5ea0c964-9eb4-43b9-9ddb-4859a4fbb144 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e" status: 200 len: 1725 microversion: 2.20 time: 0.172513 Aug 06 14:38:38.938910 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 486/923] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:38:38 2022] GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 14:38:39.924898 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-eaa6db1a-0f81-4fe7-bad5-f80facc9cc1b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:38:39.925509 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-eaa6db1a-0f81-4fe7-bad5-f80facc9cc1b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6d80056a-5ade-4f3b-8e08-adf707c34cfe] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:38:39.932099 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-eaa6db1a-0f81-4fe7-bad5-f80facc9cc1b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:39.932836 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-eaa6db1a-0f81-4fe7-bad5-f80facc9cc1b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:39.933267 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-eaa6db1a-0f81-4fe7-bad5-f80facc9cc1b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:39.933960 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-eaa6db1a-0f81-4fe7-bad5-f80facc9cc1b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:39.934410 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-eaa6db1a-0f81-4fe7-bad5-f80facc9cc1b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:39.934837 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-eaa6db1a-0f81-4fe7-bad5-f80facc9cc1b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:39.961118 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-6cb0ac9c-c655-4008-9583-6fe1ca8b0fb7 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:38:39.962594 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-6cb0ac9c-c655-4008-9583-6fe1ca8b0fb7 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:38:39.979897 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6cb0ac9c-c655-4008-9583-6fe1ca8b0fb7 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:39.980392 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6cb0ac9c-c655-4008-9583-6fe1ca8b0fb7 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:39.980829 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6cb0ac9c-c655-4008-9583-6fe1ca8b0fb7 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:39.981535 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6cb0ac9c-c655-4008-9583-6fe1ca8b0fb7 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:39.981990 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6cb0ac9c-c655-4008-9583-6fe1ca8b0fb7 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:39.982414 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6cb0ac9c-c655-4008-9583-6fe1ca8b0fb7 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:40.085309 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-eaa6db1a-0f81-4fe7-bad5-f80facc9cc1b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:40.093125 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-eaa6db1a-0f81-4fe7-bad5-f80facc9cc1b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/6d80056a-5ade-4f3b-8e08-adf707c34cfe" status: 200 len: 1681 microversion: 2.1 time: 0.172144 Aug 06 14:38:40.093692 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 438/924] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:38:39 2022] GET /compute/v2.1/servers/6d80056a-5ade-4f3b-8e08-adf707c34cfe => generated 1681 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:38:40.133793 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-6cb0ac9c-c655-4008-9583-6fe1ca8b0fb7 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:40.141827 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-6cb0ac9c-c655-4008-9583-6fe1ca8b0fb7 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:40.144382 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-6cb0ac9c-c655-4008-9583-6fe1ca8b0fb7 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:40.145600 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-6cb0ac9c-c655-4008-9583-6fe1ca8b0fb7 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e" status: 200 len: 1725 microversion: 2.20 time: 0.188451 Aug 06 14:38:40.146087 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 487/925] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:38:39 2022] GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e => generated 1725 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 14:38:41.114258 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-813d25a1-05d9-4792-a577-24ac349dffdf tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:38:41.115154 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-813d25a1-05d9-4792-a577-24ac349dffdf tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6d80056a-5ade-4f3b-8e08-adf707c34cfe] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:38:41.122149 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-813d25a1-05d9-4792-a577-24ac349dffdf tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:41.122938 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-813d25a1-05d9-4792-a577-24ac349dffdf tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:41.123938 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-813d25a1-05d9-4792-a577-24ac349dffdf tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:41.124715 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-813d25a1-05d9-4792-a577-24ac349dffdf tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:41.125260 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-813d25a1-05d9-4792-a577-24ac349dffdf tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:41.125684 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-813d25a1-05d9-4792-a577-24ac349dffdf tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:41.168225 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-5aaa8e0c-1b7a-47a8-8047-a93eccc7ac63 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:38:41.170269 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-5aaa8e0c-1b7a-47a8-8047-a93eccc7ac63 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:38:41.177765 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-5aaa8e0c-1b7a-47a8-8047-a93eccc7ac63 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:41.178692 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-5aaa8e0c-1b7a-47a8-8047-a93eccc7ac63 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:41.179484 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-5aaa8e0c-1b7a-47a8-8047-a93eccc7ac63 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:41.180635 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-5aaa8e0c-1b7a-47a8-8047-a93eccc7ac63 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:41.181451 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-5aaa8e0c-1b7a-47a8-8047-a93eccc7ac63 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:41.182115 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-5aaa8e0c-1b7a-47a8-8047-a93eccc7ac63 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:41.336845 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-5aaa8e0c-1b7a-47a8-8047-a93eccc7ac63 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:41.339034 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-813d25a1-05d9-4792-a577-24ac349dffdf tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:41.347024 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-813d25a1-05d9-4792-a577-24ac349dffdf tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/6d80056a-5ade-4f3b-8e08-adf707c34cfe" status: 200 len: 1681 microversion: 2.1 time: 0.237290 Aug 06 14:38:41.347307 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-5aaa8e0c-1b7a-47a8-8047-a93eccc7ac63 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:41.348359 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 439/926] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:38:41 2022] GET /compute/v2.1/servers/6d80056a-5ade-4f3b-8e08-adf707c34cfe => generated 1681 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:38:41.349233 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-5aaa8e0c-1b7a-47a8-8047-a93eccc7ac63 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:41.350596 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-5aaa8e0c-1b7a-47a8-8047-a93eccc7ac63 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e" status: 200 len: 1725 microversion: 2.20 time: 0.187034 Aug 06 14:38:41.351172 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 488/927] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:38:41 2022] GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e => generated 1725 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 14:38:41.741073 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [req-8abefcf3-ab4a-476c-9cfd-390c8ed259c7 req-193f895c-ecf9-4d16-97ee-a6133df49a54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d80056a-5ade-4f3b-8e08-adf707c34cfe", "name": "network-vif-deleted", "tag": "82b5d66c-2905-491d-8557-b611c573deda"}]} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:38:41.753032 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-8abefcf3-ab4a-476c-9cfd-390c8ed259c7 req-193f895c-ecf9-4d16-97ee-a6133df49a54 service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:41.753508 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-8abefcf3-ab4a-476c-9cfd-390c8ed259c7 req-193f895c-ecf9-4d16-97ee-a6133df49a54 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:41.753954 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-8abefcf3-ab4a-476c-9cfd-390c8ed259c7 req-193f895c-ecf9-4d16-97ee-a6133df49a54 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:41.765296 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.compute.server_external_events [req-8abefcf3-ab4a-476c-9cfd-390c8ed259c7 req-193f895c-ecf9-4d16-97ee-a6133df49a54 service nova] Creating event network-vif-deleted:82b5d66c-2905-491d-8557-b611c573deda for instance 6d80056a-5ade-4f3b-8e08-adf707c34cfe on hv-cinder-85199 Aug 06 14:38:41.770159 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [req-8abefcf3-ab4a-476c-9cfd-390c8ed259c7 req-193f895c-ecf9-4d16-97ee-a6133df49a54 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032709 Aug 06 14:38:41.770966 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 440/928] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:38:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:38:42.369976 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-48f7965c-f561-4a10-b5de-d26f98255133 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:38:42.371279 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-48f7965c-f561-4a10-b5de-d26f98255133 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6d80056a-5ade-4f3b-8e08-adf707c34cfe] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:38:42.375198 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-40a42d5c-bef5-41a3-ba39-3081866808a5 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:38:42.376107 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-40a42d5c-bef5-41a3-ba39-3081866808a5 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:38:42.379259 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-48f7965c-f561-4a10-b5de-d26f98255133 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:42.379974 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-48f7965c-f561-4a10-b5de-d26f98255133 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:42.380417 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-48f7965c-f561-4a10-b5de-d26f98255133 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:42.381262 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-48f7965c-f561-4a10-b5de-d26f98255133 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:42.381725 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-48f7965c-f561-4a10-b5de-d26f98255133 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:42.382149 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-48f7965c-f561-4a10-b5de-d26f98255133 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:42.384683 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-40a42d5c-bef5-41a3-ba39-3081866808a5 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:42.385301 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-40a42d5c-bef5-41a3-ba39-3081866808a5 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:42.385950 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-40a42d5c-bef5-41a3-ba39-3081866808a5 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:42.387019 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-40a42d5c-bef5-41a3-ba39-3081866808a5 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:42.387703 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-40a42d5c-bef5-41a3-ba39-3081866808a5 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:42.388224 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-40a42d5c-bef5-41a3-ba39-3081866808a5 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:42.422990 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-48f7965c-f561-4a10-b5de-d26f98255133 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:42.423598 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-48f7965c-f561-4a10-b5de-d26f98255133 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:42.424134 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-48f7965c-f561-4a10-b5de-d26f98255133 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:42.424679 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.objects.instance [None req-48f7965c-f561-4a10-b5de-d26f98255133 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lazy-loading 'fault' on Instance uuid 6d80056a-5ade-4f3b-8e08-adf707c34cfe {{(pid=117837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 14:38:42.428552 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:38:42.485283 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-48f7965c-f561-4a10-b5de-d26f98255133 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:42.502133 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-48f7965c-f561-4a10-b5de-d26f98255133 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/6d80056a-5ade-4f3b-8e08-adf707c34cfe" status: 200 len: 1332 microversion: 2.1 time: 0.136087 Aug 06 14:38:42.503070 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 489/929] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:38:42 2022] GET /compute/v2.1/servers/6d80056a-5ade-4f3b-8e08-adf707c34cfe => generated 1332 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:38:42.549458 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-40a42d5c-bef5-41a3-ba39-3081866808a5 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:42.557962 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-40a42d5c-bef5-41a3-ba39-3081866808a5 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:42.559498 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-40a42d5c-bef5-41a3-ba39-3081866808a5 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:42.561560 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-40a42d5c-bef5-41a3-ba39-3081866808a5 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e" status: 200 len: 1725 microversion: 2.20 time: 0.191113 Aug 06 14:38:42.562112 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 441/930] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:38:42 2022] GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e => generated 1725 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:38:43.523049 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-4064403d-6842-42ff-8a74-344045a222ff tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:38:43.523695 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-4064403d-6842-42ff-8a74-344045a222ff tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6d80056a-5ade-4f3b-8e08-adf707c34cfe] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:38:43.530111 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-4064403d-6842-42ff-8a74-344045a222ff tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:43.530596 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-4064403d-6842-42ff-8a74-344045a222ff tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:43.531074 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-4064403d-6842-42ff-8a74-344045a222ff tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:43.531764 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-4064403d-6842-42ff-8a74-344045a222ff tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:43.532222 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-4064403d-6842-42ff-8a74-344045a222ff tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:43.532647 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-4064403d-6842-42ff-8a74-344045a222ff tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:43.545631 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.wsgi [None req-4064403d-6842-42ff-8a74-344045a222ff tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] HTTP exception thrown: Instance 6d80056a-5ade-4f3b-8e08-adf707c34cfe could not be found. Aug 06 14:38:43.547284 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-4064403d-6842-42ff-8a74-344045a222ff tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Request method failure captured: Aug 06 14:38:43.547284 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: request: GET /compute/v2.1/servers/6d80056a-5ade-4f3b-8e08-adf707c34cfe HTTP/1.1 Aug 06 14:38:43.547284 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Accept: application/json Aug 06 14:38:43.547284 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Accept-Encoding: identity Aug 06 14:38:43.547284 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Connection: close Aug 06 14:38:43.547284 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Content-Length: 0 Aug 06 14:38:43.547284 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Content-Type: application/json Aug 06 14:38:43.547284 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Host: 10.222.0.17 Aug 06 14:38:43.547284 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Openstack-System-Scope: None Aug 06 14:38:43.547284 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: User-Agent: python-urllib3/1.26.11 Aug 06 14:38:43.547284 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Auth-Token: gAAAAABi7nrw1j_Ge2Ur2tEojXwBmjEDUihl-N8v1g20aSIVDaeL_OTgCZQS1IFihI0AmtEC1h-SgLRiudvycNkR7KjoTpqo7M5425d9Dy_4zXKbCfizwmIbraJL9PsVC3rQgInSWh6L4pF_pLJlUkvGCOVZ6ElDrY4gMQsJ7uwAoVwYy3EWJq0 Aug 06 14:38:43.547284 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Domain-Id: None Aug 06 14:38:43.547284 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Domain-Name: None Aug 06 14:38:43.547284 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Identity-Status: Confirmed Aug 06 14:38:43.547284 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Is-Admin-Project: True Aug 06 14:38:43.547284 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Domain-Id: default Aug 06 14:38:43.547284 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Domain-Name: Default Aug 06 14:38:43.547284 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Id: 96a7bb12d3ed4d1db2a58a03472483c2 Aug 06 14:38:43.547284 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Name: tempest-AttachVolumeNegativeTest-927490997 Aug 06 14:38:43.547284 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Role: member,reader Aug 06 14:38:43.547284 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Roles: member,reader Aug 06 14:38:43.548826 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/96a7bb12d3ed4d1db2a58a03472483c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/96a7bb12d3ed4d1db2a58a03472483c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_96a7bb12d3ed4d1db2a58a03472483c2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/96a7bb12d3ed4d1db2a58a03472483c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 06 14:38:43.548826 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant: tempest-AttachVolumeNegativeTest-927490997 Aug 06 14:38:43.548826 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant-Id: 96a7bb12d3ed4d1db2a58a03472483c2 Aug 06 14:38:43.548826 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-927490997 Aug 06 14:38:43.548826 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User: tempest-AttachVolumeNegativeTest-927490997-project Aug 06 14:38:43.548826 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Domain-Id: default Aug 06 14:38:43.548826 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Domain-Name: Default Aug 06 14:38:43.548826 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Id: 5378c85cd31c42dfbc39ce738a8b6dde Aug 06 14:38:43.548826 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Name: tempest-AttachVolumeNegativeTest-927490997-project Aug 06 14:38:43.548826 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: method: > Aug 06 14:38:43.548826 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: exception: Instance 6d80056a-5ade-4f3b-8e08-adf707c34cfe could not be found. Aug 06 14:38:43.548826 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: action_args: {'id': '6d80056a-5ade-4f3b-8e08-adf707c34cfe'} Aug 06 14:38:43.549641 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 14:38:43.549641 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:38:43.549641 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 14:38:43.549641 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 14:38:43.549641 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 14:38:43.549641 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 14:38:43.549641 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 14:38:43.549641 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 14:38:43.549641 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 14:38:43.549641 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 14:38:43.549641 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d80056a-5ade-4f3b-8e08-adf707c34cfe could not be found. Aug 06 14:38:43.549641 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:38:43.549641 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:38:43.549641 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:38:43.549641 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:38:43.549641 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:38:43.549641 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:38:43.549641 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 14:38:43.549641 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 14:38:43.549641 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 14:38:43.551027 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 14:38:43.551027 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 14:38:43.551027 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 14:38:43.551027 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 14:38:43.551027 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 14:38:43.551027 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 14:38:43.551027 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 14:38:43.551027 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d80056a-5ade-4f3b-8e08-adf707c34cfe could not be found. Aug 06 14:38:43.551027 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:38:43.551027 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:38:43.551027 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:38:43.551027 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:38:43.551027 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:38:43.551027 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:38:43.551027 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 14:38:43.551027 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 14:38:43.551027 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d80056a-5ade-4f3b-8e08-adf707c34cfe could not be found. Aug 06 14:38:43.551027 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:38:43.552333 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-4064403d-6842-42ff-8a74-344045a222ff tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Returning 404 to user: Instance 6d80056a-5ade-4f3b-8e08-adf707c34cfe could not be found. {{(pid=117837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 14:38:43.552333 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-4064403d-6842-42ff-8a74-344045a222ff tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/6d80056a-5ade-4f3b-8e08-adf707c34cfe" status: 404 len: 111 microversion: 2.1 time: 0.029553 Aug 06 14:38:43.552333 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 490/931] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:38:43 2022] GET /compute/v2.1/servers/6d80056a-5ade-4f3b-8e08-adf707c34cfe => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 14:38:43.557748 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-a4ee0336-b416-43eb-8ada-3ee4e4437a84 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '.version_select at 0x7fbab13c15e0>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:38:43.577450 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-a4ee0336-b416-43eb-8ada-3ee4e4437a84 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1094861768" status: 202 len: 0 microversion: 2.1 time: 0.023733 Aug 06 14:38:43.578185 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 442/932] 10.222.0.17 () {58 vars in 1221 bytes} [Sat Aug 6 14:38:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1094861768 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 14:38:43.584582 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-15ab82f2-3d0a-49f1-9ea9-2ceeb4b7eb86 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:38:43.585214 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-15ab82f2-3d0a-49f1-9ea9-2ceeb4b7eb86 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:38:43.591562 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-15ab82f2-3d0a-49f1-9ea9-2ceeb4b7eb86 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:43.592109 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-15ab82f2-3d0a-49f1-9ea9-2ceeb4b7eb86 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:43.592582 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-15ab82f2-3d0a-49f1-9ea9-2ceeb4b7eb86 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:43.593279 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-15ab82f2-3d0a-49f1-9ea9-2ceeb4b7eb86 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:43.593740 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-15ab82f2-3d0a-49f1-9ea9-2ceeb4b7eb86 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:43.594147 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-15ab82f2-3d0a-49f1-9ea9-2ceeb4b7eb86 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:43.745584 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-15ab82f2-3d0a-49f1-9ea9-2ceeb4b7eb86 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:43.754623 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-15ab82f2-3d0a-49f1-9ea9-2ceeb4b7eb86 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:43.756221 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-15ab82f2-3d0a-49f1-9ea9-2ceeb4b7eb86 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:43.757380 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-15ab82f2-3d0a-49f1-9ea9-2ceeb4b7eb86 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e" status: 200 len: 1725 microversion: 2.20 time: 0.176733 Aug 06 14:38:43.757949 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 491/933] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:38:43 2022] GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e => generated 1725 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:38:44.217802 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-d43ca801-215a-4276-bbe2-f7310e8a21c4 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Action: 'create', calling method: .version_select at 0x7fbab135c1f0>, body: {"keypair": {"name": "tempest-keypair-735452006", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNePuqZ/EQK5ft8TdkEWOwG3AS3eyTW/iglXOewN9M6U0CIdRPDLYWe84iZwsmUVN3+coRMFbrzLIPCFWQZV126sPQ/N56inJdd0BuTlBMYGQNGCFq7mInY7cBZ/jN7apw=="}} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:38:44.235479 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.quota [None req-d43ca801-215a-4276-bbe2-f7310e8a21c4 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Getting quotas for project 96a7bb12d3ed4d1db2a58a03472483c2. Resources: {'key_pairs'} {{(pid=117838) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 14:38:44.239423 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.quota [None req-d43ca801-215a-4276-bbe2-f7310e8a21c4 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Getting quotas for user 5378c85cd31c42dfbc39ce738a8b6dde and project 96a7bb12d3ed4d1db2a58a03472483c2. Resources: {'key_pairs'} {{(pid=117838) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 14:38:44.261989 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-d43ca801-215a-4276-bbe2-f7310e8a21c4 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048578 Aug 06 14:38:44.262580 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 443/934] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Aug 6 14:38:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:38:44.782533 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-e612c3d4-850f-4779-8446-9e4e98bafb59 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:38:44.783237 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-e612c3d4-850f-4779-8446-9e4e98bafb59 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:38:44.790378 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e612c3d4-850f-4779-8446-9e4e98bafb59 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:44.791181 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e612c3d4-850f-4779-8446-9e4e98bafb59 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:44.791795 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e612c3d4-850f-4779-8446-9e4e98bafb59 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:44.792696 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e612c3d4-850f-4779-8446-9e4e98bafb59 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:44.793146 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e612c3d4-850f-4779-8446-9e4e98bafb59 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:44.793568 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e612c3d4-850f-4779-8446-9e4e98bafb59 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:44.943106 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-e612c3d4-850f-4779-8446-9e4e98bafb59 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:44.952249 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-e612c3d4-850f-4779-8446-9e4e98bafb59 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:44.953777 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-e612c3d4-850f-4779-8446-9e4e98bafb59 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:44.955017 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-e612c3d4-850f-4779-8446-9e4e98bafb59 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e" status: 200 len: 1746 microversion: 2.20 time: 0.177271 Aug 06 14:38:44.955567 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 492/935] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:38:44 2022] GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e => generated 1746 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 14:38:45.853065 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-e97725be-d8fd-4789-adda-1f1ca23f8978 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-944901589", "imageRef": "13d7ee60-c9c3-43ee-9861-a9192a114a77", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9b050990-e64f-42d3-84c7-d36c3ef1c328"}], "security_groups": [{"name": "tempest-securitygroup--2142779483"}], "key_name": "tempest-keypair-735452006", "user_data": "}} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:38:45.961681 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.network.neutron [None req-e97725be-d8fd-4789-adda-1f1ca23f8978 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] validate_networks() for [('9b050990-e64f-42d3-84c7-d36c3ef1c328', None, None, None, None, None)] {{(pid=117838) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 14:38:45.980663 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-9e257581-285c-4b50-a592-b7c924bb9df0 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:38:45.981290 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-9e257581-285c-4b50-a592-b7c924bb9df0 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:38:45.987771 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9e257581-285c-4b50-a592-b7c924bb9df0 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:45.988260 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9e257581-285c-4b50-a592-b7c924bb9df0 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:45.988692 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9e257581-285c-4b50-a592-b7c924bb9df0 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:45.989379 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9e257581-285c-4b50-a592-b7c924bb9df0 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:45.989829 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9e257581-285c-4b50-a592-b7c924bb9df0 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:45.990257 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9e257581-285c-4b50-a592-b7c924bb9df0 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:46.127616 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-9e257581-285c-4b50-a592-b7c924bb9df0 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:46.137166 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-9e257581-285c-4b50-a592-b7c924bb9df0 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:46.139427 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-9e257581-285c-4b50-a592-b7c924bb9df0 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:46.140604 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-9e257581-285c-4b50-a592-b7c924bb9df0 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e" status: 200 len: 1746 microversion: 2.20 time: 0.165458 Aug 06 14:38:46.148128 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 493/936] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:38:45 2022] GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e => generated 1746 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 14:38:46.372742 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.virt.hardware [None req-e97725be-d8fd-4789-adda-1f1ca23f8978 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Flavor limits 0:0:0 {{(pid=117838) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 14:38:46.373777 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.virt.hardware [None req-e97725be-d8fd-4789-adda-1f1ca23f8978 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Image limits 0:0:0 {{(pid=117838) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 14:38:46.374260 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.virt.hardware [None req-e97725be-d8fd-4789-adda-1f1ca23f8978 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Flavor pref 0:0:0 {{(pid=117838) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 14:38:46.374689 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.virt.hardware [None req-e97725be-d8fd-4789-adda-1f1ca23f8978 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Image pref 0:0:0 {{(pid=117838) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 14:38:46.375196 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.virt.hardware [None req-e97725be-d8fd-4789-adda-1f1ca23f8978 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117838) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 14:38:46.383904 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e97725be-d8fd-4789-adda-1f1ca23f8978 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:46.384374 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e97725be-d8fd-4789-adda-1f1ca23f8978 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:46.384802 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e97725be-d8fd-4789-adda-1f1ca23f8978 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:46.385525 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e97725be-d8fd-4789-adda-1f1ca23f8978 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:46.385978 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e97725be-d8fd-4789-adda-1f1ca23f8978 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:46.386400 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e97725be-d8fd-4789-adda-1f1ca23f8978 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:46.403927 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.quota [None req-e97725be-d8fd-4789-adda-1f1ca23f8978 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Getting quotas for project 96a7bb12d3ed4d1db2a58a03472483c2. Resources: {'cores', 'instances', 'ram'} {{(pid=117838) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 14:38:46.408283 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.quota [None req-e97725be-d8fd-4789-adda-1f1ca23f8978 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Getting quotas for user 5378c85cd31c42dfbc39ce738a8b6dde and project 96a7bb12d3ed4d1db2a58a03472483c2. Resources: {'cores', 'instances', 'ram'} {{(pid=117838) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 14:38:46.419148 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-e97725be-d8fd-4789-adda-1f1ca23f8978 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Going to run 1 instances... {{(pid=117838) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 14:38:46.421410 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-e97725be-d8fd-4789-adda-1f1ca23f8978 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 4ae413eb-83c0-48ab-818c-f75d9727d345] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='13d7ee60-c9c3-43ee-9861-a9192a114a77',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117838) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 14:38:46.466343 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-e97725be-d8fd-4789-adda-1f1ca23f8978 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.618279 Aug 06 14:38:46.467029 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 444/937] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Aug 6 14:38:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 14:38:46.477805 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-3c89854c-bf3e-4315-b5bf-f305b5c36e42 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:38:46.478414 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-3c89854c-bf3e-4315-b5bf-f305b5c36e42 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 4ae413eb-83c0-48ab-818c-f75d9727d345] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:38:46.535849 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-3c89854c-bf3e-4315-b5bf-f305b5c36e42 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:46.543159 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-3c89854c-bf3e-4315-b5bf-f305b5c36e42 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/4ae413eb-83c0-48ab-818c-f75d9727d345" status: 200 len: 1240 microversion: 2.1 time: 0.069167 Aug 06 14:38:46.543839 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 494/938] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:38:46 2022] GET /compute/v2.1/servers/4ae413eb-83c0-48ab-818c-f75d9727d345 => generated 1240 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:38:47.164256 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-3fa04cd9-7e0a-47e1-be56-9749e5db7984 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:38:47.164893 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-3fa04cd9-7e0a-47e1-be56-9749e5db7984 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:38:47.171512 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3fa04cd9-7e0a-47e1-be56-9749e5db7984 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:47.171990 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3fa04cd9-7e0a-47e1-be56-9749e5db7984 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:47.172425 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3fa04cd9-7e0a-47e1-be56-9749e5db7984 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:47.173109 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3fa04cd9-7e0a-47e1-be56-9749e5db7984 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:47.173557 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3fa04cd9-7e0a-47e1-be56-9749e5db7984 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:47.173982 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3fa04cd9-7e0a-47e1-be56-9749e5db7984 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:47.299254 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-3fa04cd9-7e0a-47e1-be56-9749e5db7984 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:47.307638 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-3fa04cd9-7e0a-47e1-be56-9749e5db7984 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:47.309137 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-3fa04cd9-7e0a-47e1-be56-9749e5db7984 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:47.310287 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-3fa04cd9-7e0a-47e1-be56-9749e5db7984 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e" status: 200 len: 1746 microversion: 2.20 time: 0.150506 Aug 06 14:38:47.310832 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 445/939] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:38:47 2022] GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e => generated 1746 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:38:47.493498 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [req-58a0fb07-c57e-4fab-8939-6fbdcd62b4d6 req-286da48c-ef0f-40e1-a4ae-4c256f6ad572 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91e50552-3108-4fca-82ca-e299af40061e", "name": "network-vif-plugged", "status": "completed", "tag": "d910f3cd-711d-43f7-8b9c-b79ca1e620bd"}]} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:38:47.509719 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-58a0fb07-c57e-4fab-8939-6fbdcd62b4d6 req-286da48c-ef0f-40e1-a4ae-4c256f6ad572 service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:47.510637 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-58a0fb07-c57e-4fab-8939-6fbdcd62b4d6 req-286da48c-ef0f-40e1-a4ae-4c256f6ad572 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:47.515124 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-58a0fb07-c57e-4fab-8939-6fbdcd62b4d6 req-286da48c-ef0f-40e1-a4ae-4c256f6ad572 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:47.546040 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.compute.server_external_events [req-58a0fb07-c57e-4fab-8939-6fbdcd62b4d6 req-286da48c-ef0f-40e1-a4ae-4c256f6ad572 service nova] Creating event network-vif-plugged:d910f3cd-711d-43f7-8b9c-b79ca1e620bd for instance 91e50552-3108-4fca-82ca-e299af40061e on hv-cinder-85199 Aug 06 14:38:47.565712 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-2a4cc28f-6413-4390-9ae9-bf41cb7c10fa tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:38:47.566545 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-2a4cc28f-6413-4390-9ae9-bf41cb7c10fa tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 4ae413eb-83c0-48ab-818c-f75d9727d345] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:38:47.575196 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [req-58a0fb07-c57e-4fab-8939-6fbdcd62b4d6 req-286da48c-ef0f-40e1-a4ae-4c256f6ad572 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086357 Aug 06 14:38:47.575943 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 495/940] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:38:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:38:47.577389 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2a4cc28f-6413-4390-9ae9-bf41cb7c10fa tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:47.578041 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2a4cc28f-6413-4390-9ae9-bf41cb7c10fa tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:47.578992 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2a4cc28f-6413-4390-9ae9-bf41cb7c10fa tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:47.579841 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2a4cc28f-6413-4390-9ae9-bf41cb7c10fa tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:47.580368 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2a4cc28f-6413-4390-9ae9-bf41cb7c10fa tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:47.580866 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2a4cc28f-6413-4390-9ae9-bf41cb7c10fa tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:47.649527 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-2a4cc28f-6413-4390-9ae9-bf41cb7c10fa tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:47.657977 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-2a4cc28f-6413-4390-9ae9-bf41cb7c10fa tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/4ae413eb-83c0-48ab-818c-f75d9727d345" status: 200 len: 1310 microversion: 2.1 time: 0.096852 Aug 06 14:38:47.658635 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 446/941] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:38:47 2022] GET /compute/v2.1/servers/4ae413eb-83c0-48ab-818c-f75d9727d345 => generated 1310 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:38:48.333308 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-adfd93cf-7677-449e-83c8-d941b6727996 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:38:48.334436 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-adfd93cf-7677-449e-83c8-d941b6727996 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:38:48.341983 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-adfd93cf-7677-449e-83c8-d941b6727996 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:48.342476 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-adfd93cf-7677-449e-83c8-d941b6727996 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:48.343023 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-adfd93cf-7677-449e-83c8-d941b6727996 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:48.343931 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-adfd93cf-7677-449e-83c8-d941b6727996 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:48.344416 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-adfd93cf-7677-449e-83c8-d941b6727996 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:48.344836 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-adfd93cf-7677-449e-83c8-d941b6727996 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:48.521782 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-adfd93cf-7677-449e-83c8-d941b6727996 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:48.528550 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-adfd93cf-7677-449e-83c8-d941b6727996 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:48.530136 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-adfd93cf-7677-449e-83c8-d941b6727996 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:48.531388 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-adfd93cf-7677-449e-83c8-d941b6727996 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e" status: 200 len: 1746 microversion: 2.20 time: 0.202436 Aug 06 14:38:48.532252 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 496/942] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:38:48 2022] GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e => generated 1746 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:38:48.679121 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-c014b5ae-d584-40b4-b895-fc21626a60ad tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:38:48.679731 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-c014b5ae-d584-40b4-b895-fc21626a60ad tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 4ae413eb-83c0-48ab-818c-f75d9727d345] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:38:48.686884 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c014b5ae-d584-40b4-b895-fc21626a60ad tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:48.687369 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c014b5ae-d584-40b4-b895-fc21626a60ad tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:48.687985 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c014b5ae-d584-40b4-b895-fc21626a60ad tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:48.688694 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c014b5ae-d584-40b4-b895-fc21626a60ad tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:48.689147 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c014b5ae-d584-40b4-b895-fc21626a60ad tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:48.689571 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c014b5ae-d584-40b4-b895-fc21626a60ad tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:48.939225 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-c014b5ae-d584-40b4-b895-fc21626a60ad tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:48.946541 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-c014b5ae-d584-40b4-b895-fc21626a60ad tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/4ae413eb-83c0-48ab-818c-f75d9727d345" status: 200 len: 1366 microversion: 2.1 time: 0.271499 Aug 06 14:38:48.947123 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 447/943] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:38:48 2022] GET /compute/v2.1/servers/4ae413eb-83c0-48ab-818c-f75d9727d345 => generated 1366 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:38:49.059593 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [req-dec5181f-cced-4cf4-aa59-cf5561a0d6f5 req-22e6cf37-993a-45ec-bfc9-4e476de0dc49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ae413eb-83c0-48ab-818c-f75d9727d345", "tag": "12dea44a-bac1-426f-adfb-65593fd7191e"}]} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:38:49.075186 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-dec5181f-cced-4cf4-aa59-cf5561a0d6f5 req-22e6cf37-993a-45ec-bfc9-4e476de0dc49 service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:49.075637 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-dec5181f-cced-4cf4-aa59-cf5561a0d6f5 req-22e6cf37-993a-45ec-bfc9-4e476de0dc49 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:49.076592 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-dec5181f-cced-4cf4-aa59-cf5561a0d6f5 req-22e6cf37-993a-45ec-bfc9-4e476de0dc49 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:49.088348 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.compute.server_external_events [req-dec5181f-cced-4cf4-aa59-cf5561a0d6f5 req-22e6cf37-993a-45ec-bfc9-4e476de0dc49 service nova] Creating event network-changed:12dea44a-bac1-426f-adfb-65593fd7191e for instance 4ae413eb-83c0-48ab-818c-f75d9727d345 on hv-cinder-85199 Aug 06 14:38:49.093866 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [req-dec5181f-cced-4cf4-aa59-cf5561a0d6f5 req-22e6cf37-993a-45ec-bfc9-4e476de0dc49 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038213 Aug 06 14:38:49.094456 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 497/944] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:38:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:38:49.555857 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-f196c4dc-ff32-40ec-a8f2-c311633b0870 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:38:49.556585 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-f196c4dc-ff32-40ec-a8f2-c311633b0870 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:38:49.563509 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f196c4dc-ff32-40ec-a8f2-c311633b0870 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:49.563986 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f196c4dc-ff32-40ec-a8f2-c311633b0870 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:49.564411 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f196c4dc-ff32-40ec-a8f2-c311633b0870 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:49.565095 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f196c4dc-ff32-40ec-a8f2-c311633b0870 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:49.565551 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f196c4dc-ff32-40ec-a8f2-c311633b0870 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:49.565964 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f196c4dc-ff32-40ec-a8f2-c311633b0870 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:49.693899 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-f196c4dc-ff32-40ec-a8f2-c311633b0870 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:49.701875 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-f196c4dc-ff32-40ec-a8f2-c311633b0870 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:49.703395 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-f196c4dc-ff32-40ec-a8f2-c311633b0870 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:49.704535 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-f196c4dc-ff32-40ec-a8f2-c311633b0870 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e" status: 200 len: 1746 microversion: 2.20 time: 0.152667 Aug 06 14:38:49.705085 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 448/945] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:38:49 2022] GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:38:49.968117 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-fefdffad-4a3f-43f4-b3a7-9a66cf890243 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:38:49.968889 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-fefdffad-4a3f-43f4-b3a7-9a66cf890243 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 4ae413eb-83c0-48ab-818c-f75d9727d345] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:38:49.974816 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-fefdffad-4a3f-43f4-b3a7-9a66cf890243 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:49.975321 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-fefdffad-4a3f-43f4-b3a7-9a66cf890243 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:49.975752 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-fefdffad-4a3f-43f4-b3a7-9a66cf890243 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:49.976435 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-fefdffad-4a3f-43f4-b3a7-9a66cf890243 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:49.976882 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-fefdffad-4a3f-43f4-b3a7-9a66cf890243 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:49.977303 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-fefdffad-4a3f-43f4-b3a7-9a66cf890243 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:50.115914 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-fefdffad-4a3f-43f4-b3a7-9a66cf890243 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:50.123870 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-fefdffad-4a3f-43f4-b3a7-9a66cf890243 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/4ae413eb-83c0-48ab-818c-f75d9727d345" status: 200 len: 1366 microversion: 2.1 time: 0.160922 Aug 06 14:38:50.124445 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 498/946] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:38:49 2022] GET /compute/v2.1/servers/4ae413eb-83c0-48ab-818c-f75d9727d345 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:38:50.727679 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-d58dfe83-33d7-4fb9-bf2b-90260e74c070 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:38:50.728893 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-d58dfe83-33d7-4fb9-bf2b-90260e74c070 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:38:50.736146 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d58dfe83-33d7-4fb9-bf2b-90260e74c070 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:50.736690 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d58dfe83-33d7-4fb9-bf2b-90260e74c070 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:50.737124 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d58dfe83-33d7-4fb9-bf2b-90260e74c070 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:50.737849 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d58dfe83-33d7-4fb9-bf2b-90260e74c070 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:50.738354 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d58dfe83-33d7-4fb9-bf2b-90260e74c070 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:50.738780 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d58dfe83-33d7-4fb9-bf2b-90260e74c070 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:50.880943 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-d58dfe83-33d7-4fb9-bf2b-90260e74c070 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:50.888928 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-d58dfe83-33d7-4fb9-bf2b-90260e74c070 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:50.890437 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-d58dfe83-33d7-4fb9-bf2b-90260e74c070 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:50.891627 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-d58dfe83-33d7-4fb9-bf2b-90260e74c070 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e" status: 200 len: 1746 microversion: 2.20 time: 0.167800 Aug 06 14:38:50.892179 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 449/947] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:38:50 2022] GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e => generated 1746 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:38:51.145094 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-58c3557b-078c-4cc0-9eb0-df9151d13833 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:38:51.146017 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-58c3557b-078c-4cc0-9eb0-df9151d13833 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 4ae413eb-83c0-48ab-818c-f75d9727d345] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:38:51.152778 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-58c3557b-078c-4cc0-9eb0-df9151d13833 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:51.153365 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-58c3557b-078c-4cc0-9eb0-df9151d13833 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:51.153864 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-58c3557b-078c-4cc0-9eb0-df9151d13833 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:51.155083 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-58c3557b-078c-4cc0-9eb0-df9151d13833 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:51.155537 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-58c3557b-078c-4cc0-9eb0-df9151d13833 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:51.155963 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-58c3557b-078c-4cc0-9eb0-df9151d13833 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:51.292955 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-58c3557b-078c-4cc0-9eb0-df9151d13833 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:51.300737 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-58c3557b-078c-4cc0-9eb0-df9151d13833 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/4ae413eb-83c0-48ab-818c-f75d9727d345" status: 200 len: 1366 microversion: 2.1 time: 0.159594 Aug 06 14:38:51.301311 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 499/948] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:38:51 2022] GET /compute/v2.1/servers/4ae413eb-83c0-48ab-818c-f75d9727d345 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:38:51.914612 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-7a1dd031-0f6e-4cd7-81f2-86b3c0423e78 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:38:51.915387 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-7a1dd031-0f6e-4cd7-81f2-86b3c0423e78 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:38:51.921829 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7a1dd031-0f6e-4cd7-81f2-86b3c0423e78 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:51.922308 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7a1dd031-0f6e-4cd7-81f2-86b3c0423e78 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:51.922738 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7a1dd031-0f6e-4cd7-81f2-86b3c0423e78 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:51.923458 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7a1dd031-0f6e-4cd7-81f2-86b3c0423e78 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:51.923907 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7a1dd031-0f6e-4cd7-81f2-86b3c0423e78 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:51.924326 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7a1dd031-0f6e-4cd7-81f2-86b3c0423e78 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:51.943192 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_cell1:SELECT=100 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:38:52.154845 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-7a1dd031-0f6e-4cd7-81f2-86b3c0423e78 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:52.169001 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-7a1dd031-0f6e-4cd7-81f2-86b3c0423e78 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:52.172663 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-7a1dd031-0f6e-4cd7-81f2-86b3c0423e78 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:52.175387 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-7a1dd031-0f6e-4cd7-81f2-86b3c0423e78 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e" status: 200 len: 1746 microversion: 2.20 time: 0.264077 Aug 06 14:38:52.179432 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 450/949] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:38:51 2022] GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e => generated 1746 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:38:52.326510 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-fe7b7dc9-4c3a-416c-9436-cc5842f616b6 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:38:52.327407 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-fe7b7dc9-4c3a-416c-9436-cc5842f616b6 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 4ae413eb-83c0-48ab-818c-f75d9727d345] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:38:52.337241 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-fe7b7dc9-4c3a-416c-9436-cc5842f616b6 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:52.337734 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-fe7b7dc9-4c3a-416c-9436-cc5842f616b6 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:52.338344 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-fe7b7dc9-4c3a-416c-9436-cc5842f616b6 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:52.339082 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-fe7b7dc9-4c3a-416c-9436-cc5842f616b6 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:52.339545 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-fe7b7dc9-4c3a-416c-9436-cc5842f616b6 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:52.340522 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-fe7b7dc9-4c3a-416c-9436-cc5842f616b6 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:52.495393 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-fe7b7dc9-4c3a-416c-9436-cc5842f616b6 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:52.512338 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-fe7b7dc9-4c3a-416c-9436-cc5842f616b6 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/4ae413eb-83c0-48ab-818c-f75d9727d345" status: 200 len: 1366 microversion: 2.1 time: 0.193976 Aug 06 14:38:52.526497 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 500/950] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:38:52 2022] GET /compute/v2.1/servers/4ae413eb-83c0-48ab-818c-f75d9727d345 => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:38:53.202239 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-46009294-57fd-4d0e-9e4f-ef169420e2c5 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:38:53.203615 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-46009294-57fd-4d0e-9e4f-ef169420e2c5 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:38:53.210691 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-46009294-57fd-4d0e-9e4f-ef169420e2c5 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:53.211325 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-46009294-57fd-4d0e-9e4f-ef169420e2c5 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:53.211852 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-46009294-57fd-4d0e-9e4f-ef169420e2c5 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:53.212624 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-46009294-57fd-4d0e-9e4f-ef169420e2c5 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:53.213195 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-46009294-57fd-4d0e-9e4f-ef169420e2c5 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:53.213689 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-46009294-57fd-4d0e-9e4f-ef169420e2c5 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:53.392186 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-46009294-57fd-4d0e-9e4f-ef169420e2c5 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:53.406691 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-46009294-57fd-4d0e-9e4f-ef169420e2c5 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:53.408657 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-46009294-57fd-4d0e-9e4f-ef169420e2c5 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:53.412458 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-46009294-57fd-4d0e-9e4f-ef169420e2c5 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e" status: 200 len: 1741 microversion: 2.20 time: 0.214608 Aug 06 14:38:53.415284 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 451/951] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:38:53 2022] GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e => generated 1741 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 14:38:53.534841 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-178c963d-5030-4786-b475-4c1a551687c5 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:38:53.536420 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-178c963d-5030-4786-b475-4c1a551687c5 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 4ae413eb-83c0-48ab-818c-f75d9727d345] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:38:53.545772 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-178c963d-5030-4786-b475-4c1a551687c5 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:53.546647 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-178c963d-5030-4786-b475-4c1a551687c5 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:53.547181 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-178c963d-5030-4786-b475-4c1a551687c5 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:53.548138 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-178c963d-5030-4786-b475-4c1a551687c5 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:53.548791 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-178c963d-5030-4786-b475-4c1a551687c5 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:53.549427 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-178c963d-5030-4786-b475-4c1a551687c5 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:53.708521 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-178c963d-5030-4786-b475-4c1a551687c5 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:53.717023 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-178c963d-5030-4786-b475-4c1a551687c5 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/4ae413eb-83c0-48ab-818c-f75d9727d345" status: 200 len: 1366 microversion: 2.1 time: 0.188358 Aug 06 14:38:53.717814 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 501/952] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:38:53 2022] GET /compute/v2.1/servers/4ae413eb-83c0-48ab-818c-f75d9727d345 => generated 1366 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:38:54.442403 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-642b658f-5970-4f46-bd72-b7a68ad02da9 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:38:54.443237 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-642b658f-5970-4f46-bd72-b7a68ad02da9 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:38:54.450170 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-642b658f-5970-4f46-bd72-b7a68ad02da9 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:54.450642 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-642b658f-5970-4f46-bd72-b7a68ad02da9 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:54.451782 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-642b658f-5970-4f46-bd72-b7a68ad02da9 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:54.452736 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-642b658f-5970-4f46-bd72-b7a68ad02da9 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:54.453295 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-642b658f-5970-4f46-bd72-b7a68ad02da9 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:54.453911 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-642b658f-5970-4f46-bd72-b7a68ad02da9 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:54.608859 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-642b658f-5970-4f46-bd72-b7a68ad02da9 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:54.617363 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-642b658f-5970-4f46-bd72-b7a68ad02da9 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:54.619292 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-642b658f-5970-4f46-bd72-b7a68ad02da9 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:54.620656 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-642b658f-5970-4f46-bd72-b7a68ad02da9 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e" status: 200 len: 1741 microversion: 2.20 time: 0.184906 Aug 06 14:38:54.621719 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 452/953] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:38:54 2022] GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e => generated 1741 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:38:54.739960 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-252d5422-b520-4f3d-a482-a89397866b9b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:38:54.740577 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-252d5422-b520-4f3d-a482-a89397866b9b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 4ae413eb-83c0-48ab-818c-f75d9727d345] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:38:54.753127 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-252d5422-b520-4f3d-a482-a89397866b9b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:54.753621 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-252d5422-b520-4f3d-a482-a89397866b9b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:54.754063 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-252d5422-b520-4f3d-a482-a89397866b9b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:54.754771 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-252d5422-b520-4f3d-a482-a89397866b9b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:54.755258 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-252d5422-b520-4f3d-a482-a89397866b9b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:54.755692 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-252d5422-b520-4f3d-a482-a89397866b9b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:54.908407 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-252d5422-b520-4f3d-a482-a89397866b9b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:54.916184 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-252d5422-b520-4f3d-a482-a89397866b9b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/4ae413eb-83c0-48ab-818c-f75d9727d345" status: 200 len: 1366 microversion: 2.1 time: 0.182890 Aug 06 14:38:54.917289 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 502/954] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:38:54 2022] GET /compute/v2.1/servers/4ae413eb-83c0-48ab-818c-f75d9727d345 => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:38:55.559662 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [req-62cd32a2-190a-4c24-95ad-61565483a955 req-0b211d59-1a91-4649-85ac-03c6a8477da7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ae413eb-83c0-48ab-818c-f75d9727d345", "name": "network-vif-plugged", "status": "completed", "tag": "12dea44a-bac1-426f-adfb-65593fd7191e"}]} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:38:55.571708 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-62cd32a2-190a-4c24-95ad-61565483a955 req-0b211d59-1a91-4649-85ac-03c6a8477da7 service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:55.572342 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-62cd32a2-190a-4c24-95ad-61565483a955 req-0b211d59-1a91-4649-85ac-03c6a8477da7 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:55.572766 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-62cd32a2-190a-4c24-95ad-61565483a955 req-0b211d59-1a91-4649-85ac-03c6a8477da7 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:55.596655 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.compute.server_external_events [req-62cd32a2-190a-4c24-95ad-61565483a955 req-0b211d59-1a91-4649-85ac-03c6a8477da7 service nova] Creating event network-vif-plugged:12dea44a-bac1-426f-adfb-65593fd7191e for instance 4ae413eb-83c0-48ab-818c-f75d9727d345 on hv-cinder-85199 Aug 06 14:38:55.602217 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [req-62cd32a2-190a-4c24-95ad-61565483a955 req-0b211d59-1a91-4649-85ac-03c6a8477da7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046914 Aug 06 14:38:55.603657 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 453/955] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:38:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:38:55.653239 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-1d3e8e04-5a4c-49c7-9a8e-c492ca1fdd8a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:38:55.655407 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-1d3e8e04-5a4c-49c7-9a8e-c492ca1fdd8a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:38:55.668581 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1d3e8e04-5a4c-49c7-9a8e-c492ca1fdd8a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:55.668825 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1d3e8e04-5a4c-49c7-9a8e-c492ca1fdd8a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:55.670243 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1d3e8e04-5a4c-49c7-9a8e-c492ca1fdd8a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:55.671585 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1d3e8e04-5a4c-49c7-9a8e-c492ca1fdd8a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:55.672224 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1d3e8e04-5a4c-49c7-9a8e-c492ca1fdd8a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:55.672645 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1d3e8e04-5a4c-49c7-9a8e-c492ca1fdd8a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:55.930472 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-1d3e8e04-5a4c-49c7-9a8e-c492ca1fdd8a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:55.937499 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-153ced60-1d34-4b42-a75b-0c3f2b703e66 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:38:55.938205 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-153ced60-1d34-4b42-a75b-0c3f2b703e66 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 4ae413eb-83c0-48ab-818c-f75d9727d345] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:38:55.940032 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-1d3e8e04-5a4c-49c7-9a8e-c492ca1fdd8a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:55.942549 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-1d3e8e04-5a4c-49c7-9a8e-c492ca1fdd8a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:55.944257 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-1d3e8e04-5a4c-49c7-9a8e-c492ca1fdd8a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e" status: 200 len: 1741 microversion: 2.20 time: 0.298050 Aug 06 14:38:55.945088 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 503/956] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:38:55 2022] GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e => generated 1741 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:38:55.951852 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-153ced60-1d34-4b42-a75b-0c3f2b703e66 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:55.953790 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-153ced60-1d34-4b42-a75b-0c3f2b703e66 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:55.954273 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-153ced60-1d34-4b42-a75b-0c3f2b703e66 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:55.955077 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-153ced60-1d34-4b42-a75b-0c3f2b703e66 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:55.955538 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-153ced60-1d34-4b42-a75b-0c3f2b703e66 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:55.955959 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-153ced60-1d34-4b42-a75b-0c3f2b703e66 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:56.202392 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-153ced60-1d34-4b42-a75b-0c3f2b703e66 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:56.213104 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-153ced60-1d34-4b42-a75b-0c3f2b703e66 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/4ae413eb-83c0-48ab-818c-f75d9727d345" status: 200 len: 1366 microversion: 2.1 time: 0.279823 Aug 06 14:38:56.214380 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 454/957] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:38:55 2022] GET /compute/v2.1/servers/4ae413eb-83c0-48ab-818c-f75d9727d345 => generated 1366 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:38:56.970705 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-d91d0241-2506-41dd-8aec-452ab2735666 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:38:56.971437 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-d91d0241-2506-41dd-8aec-452ab2735666 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:38:56.975340 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_cell0:SELECT=2 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:38:56.982123 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d91d0241-2506-41dd-8aec-452ab2735666 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:56.982695 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d91d0241-2506-41dd-8aec-452ab2735666 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:56.983247 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d91d0241-2506-41dd-8aec-452ab2735666 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:56.984139 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d91d0241-2506-41dd-8aec-452ab2735666 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:56.984775 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d91d0241-2506-41dd-8aec-452ab2735666 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:56.985214 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d91d0241-2506-41dd-8aec-452ab2735666 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:57.173216 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-d91d0241-2506-41dd-8aec-452ab2735666 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:57.184020 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-d91d0241-2506-41dd-8aec-452ab2735666 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:57.186295 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-d91d0241-2506-41dd-8aec-452ab2735666 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:57.187507 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-d91d0241-2506-41dd-8aec-452ab2735666 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e" status: 200 len: 1741 microversion: 2.20 time: 0.220668 Aug 06 14:38:57.192573 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 504/958] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:38:56 2022] GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e => generated 1741 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:38:57.235475 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_cell0:SELECT=2 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:38:57.236223 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_cell0:SELECT=10 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:38:57.241015 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-17b1d95b-5c63-460f-a6e5-f74597092107 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:38:57.241620 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-17b1d95b-5c63-460f-a6e5-f74597092107 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 4ae413eb-83c0-48ab-818c-f75d9727d345] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:38:57.249087 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-17b1d95b-5c63-460f-a6e5-f74597092107 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:57.249565 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-17b1d95b-5c63-460f-a6e5-f74597092107 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:57.250180 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-17b1d95b-5c63-460f-a6e5-f74597092107 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:57.250893 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-17b1d95b-5c63-460f-a6e5-f74597092107 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:57.251501 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-17b1d95b-5c63-460f-a6e5-f74597092107 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:57.252075 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-17b1d95b-5c63-460f-a6e5-f74597092107 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:57.420370 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-17b1d95b-5c63-460f-a6e5-f74597092107 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:57.430210 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-17b1d95b-5c63-460f-a6e5-f74597092107 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/4ae413eb-83c0-48ab-818c-f75d9727d345" status: 200 len: 1366 microversion: 2.1 time: 0.195417 Aug 06 14:38:57.443762 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 455/959] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:38:57 2022] GET /compute/v2.1/servers/4ae413eb-83c0-48ab-818c-f75d9727d345 => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:38:58.211480 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-e7f8df4d-85d1-46b8-8cda-cd5cb993f988 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:38:58.213040 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-e7f8df4d-85d1-46b8-8cda-cd5cb993f988 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:38:58.219777 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e7f8df4d-85d1-46b8-8cda-cd5cb993f988 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:58.220551 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e7f8df4d-85d1-46b8-8cda-cd5cb993f988 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:58.221196 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e7f8df4d-85d1-46b8-8cda-cd5cb993f988 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:58.221953 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e7f8df4d-85d1-46b8-8cda-cd5cb993f988 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:58.222521 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e7f8df4d-85d1-46b8-8cda-cd5cb993f988 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:58.223037 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e7f8df4d-85d1-46b8-8cda-cd5cb993f988 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:58.392062 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-e7f8df4d-85d1-46b8-8cda-cd5cb993f988 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:58.401133 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-e7f8df4d-85d1-46b8-8cda-cd5cb993f988 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:58.402677 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-e7f8df4d-85d1-46b8-8cda-cd5cb993f988 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:58.404434 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-e7f8df4d-85d1-46b8-8cda-cd5cb993f988 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e" status: 200 len: 1741 microversion: 2.20 time: 0.196314 Aug 06 14:38:58.405029 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 505/960] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:38:58 2022] GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e => generated 1741 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:38:58.453707 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-5c9bb31b-57de-4baa-8fa8-f1523604ad6d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:38:58.454326 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-5c9bb31b-57de-4baa-8fa8-f1523604ad6d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 4ae413eb-83c0-48ab-818c-f75d9727d345] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:38:58.458648 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_api:SELECT=76,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:38:58.463507 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5c9bb31b-57de-4baa-8fa8-f1523604ad6d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:58.464003 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5c9bb31b-57de-4baa-8fa8-f1523604ad6d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:58.464440 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5c9bb31b-57de-4baa-8fa8-f1523604ad6d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:58.465159 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5c9bb31b-57de-4baa-8fa8-f1523604ad6d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:58.465646 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5c9bb31b-57de-4baa-8fa8-f1523604ad6d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:58.466072 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5c9bb31b-57de-4baa-8fa8-f1523604ad6d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:58.629634 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-5c9bb31b-57de-4baa-8fa8-f1523604ad6d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:58.639674 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-5c9bb31b-57de-4baa-8fa8-f1523604ad6d tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/4ae413eb-83c0-48ab-818c-f75d9727d345" status: 200 len: 1555 microversion: 2.1 time: 0.189866 Aug 06 14:38:58.640255 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 456/961] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:38:58 2022] GET /compute/v2.1/servers/4ae413eb-83c0-48ab-818c-f75d9727d345 => generated 1555 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:38:58.663261 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-3d5fe09b-27c8-405d-ad4d-e0c97cbd1a05 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:38:58.663838 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-3d5fe09b-27c8-405d-ad4d-e0c97cbd1a05 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 4ae413eb-83c0-48ab-818c-f75d9727d345] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:38:58.670255 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-3d5fe09b-27c8-405d-ad4d-e0c97cbd1a05 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:58.670812 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-3d5fe09b-27c8-405d-ad4d-e0c97cbd1a05 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:58.671329 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-3d5fe09b-27c8-405d-ad4d-e0c97cbd1a05 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:58.672078 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-3d5fe09b-27c8-405d-ad4d-e0c97cbd1a05 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:58.672591 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-3d5fe09b-27c8-405d-ad4d-e0c97cbd1a05 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:58.673075 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-3d5fe09b-27c8-405d-ad4d-e0c97cbd1a05 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:58.782307 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-3d5fe09b-27c8-405d-ad4d-e0c97cbd1a05 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/4ae413eb-83c0-48ab-818c-f75d9727d345/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.122560 Aug 06 14:38:58.786933 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 506/962] 10.222.0.17 () {58 vars in 1275 bytes} [Sat Aug 6 14:38:58 2022] GET /compute/v2.1/servers/4ae413eb-83c0-48ab-818c-f75d9727d345/os-interface => generated 284 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:38:59.429018 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-03e7aa0f-4d69-49c7-adc3-08990afb9b98 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:38:59.429762 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-03e7aa0f-4d69-49c7-adc3-08990afb9b98 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:38:59.439046 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-03e7aa0f-4d69-49c7-adc3-08990afb9b98 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:59.439837 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-03e7aa0f-4d69-49c7-adc3-08990afb9b98 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:59.440513 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-03e7aa0f-4d69-49c7-adc3-08990afb9b98 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:59.441459 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-03e7aa0f-4d69-49c7-adc3-08990afb9b98 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:59.441980 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-03e7aa0f-4d69-49c7-adc3-08990afb9b98 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:59.442471 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-03e7aa0f-4d69-49c7-adc3-08990afb9b98 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:59.683746 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-03e7aa0f-4d69-49c7-adc3-08990afb9b98 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:59.693902 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-03e7aa0f-4d69-49c7-adc3-08990afb9b98 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:59.696710 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-03e7aa0f-4d69-49c7-adc3-08990afb9b98 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:38:59.698232 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-03e7aa0f-4d69-49c7-adc3-08990afb9b98 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e" status: 200 len: 1741 microversion: 2.20 time: 0.273867 Aug 06 14:38:59.698966 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 457/963] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:38:59 2022] GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e => generated 1741 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:38:59.969195 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [req-b9eccbc5-cafc-4a3d-b400-eae5dfda0bc0 req-a5a53e5b-0223-4c44-8fe2-72230132f246 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ae413eb-83c0-48ab-818c-f75d9727d345", "tag": "12dea44a-bac1-426f-adfb-65593fd7191e"}]} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:38:59.974660 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:38:59.981377 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-b9eccbc5-cafc-4a3d-b400-eae5dfda0bc0 req-a5a53e5b-0223-4c44-8fe2-72230132f246 service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:38:59.982244 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-b9eccbc5-cafc-4a3d-b400-eae5dfda0bc0 req-a5a53e5b-0223-4c44-8fe2-72230132f246 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:38:59.982745 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-b9eccbc5-cafc-4a3d-b400-eae5dfda0bc0 req-a5a53e5b-0223-4c44-8fe2-72230132f246 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:38:59.998823 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.compute.server_external_events [req-b9eccbc5-cafc-4a3d-b400-eae5dfda0bc0 req-a5a53e5b-0223-4c44-8fe2-72230132f246 service nova] Creating event network-changed:12dea44a-bac1-426f-adfb-65593fd7191e for instance 4ae413eb-83c0-48ab-818c-f75d9727d345 on hv-cinder-85199 Aug 06 14:39:00.004749 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [req-b9eccbc5-cafc-4a3d-b400-eae5dfda0bc0 req-a5a53e5b-0223-4c44-8fe2-72230132f246 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040745 Aug 06 14:39:00.005749 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 507/964] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:38:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:39:00.726757 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-0734aa88-a276-43f1-a787-6c693ff3b9ca tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:39:00.727669 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-0734aa88-a276-43f1-a787-6c693ff3b9ca tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:39:00.735197 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0734aa88-a276-43f1-a787-6c693ff3b9ca tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:00.735735 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0734aa88-a276-43f1-a787-6c693ff3b9ca tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:00.736095 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0734aa88-a276-43f1-a787-6c693ff3b9ca tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:00.737258 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0734aa88-a276-43f1-a787-6c693ff3b9ca tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:00.738223 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0734aa88-a276-43f1-a787-6c693ff3b9ca tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:00.738794 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0734aa88-a276-43f1-a787-6c693ff3b9ca tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:00.913830 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-0734aa88-a276-43f1-a787-6c693ff3b9ca tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:00.928552 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-0734aa88-a276-43f1-a787-6c693ff3b9ca tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:00.933182 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-0734aa88-a276-43f1-a787-6c693ff3b9ca tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:00.934824 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-0734aa88-a276-43f1-a787-6c693ff3b9ca tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e" status: 200 len: 1741 microversion: 2.20 time: 0.215362 Aug 06 14:39:00.935972 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 458/965] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:39:00 2022] GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e => generated 1741 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 06 14:39:01.959150 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-afb9de98-2d23-450a-87eb-bc618095a41a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:39:01.960444 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-afb9de98-2d23-450a-87eb-bc618095a41a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:39:01.967769 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-afb9de98-2d23-450a-87eb-bc618095a41a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:01.968466 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-afb9de98-2d23-450a-87eb-bc618095a41a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:01.969131 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-afb9de98-2d23-450a-87eb-bc618095a41a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:01.970017 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-afb9de98-2d23-450a-87eb-bc618095a41a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:01.970600 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-afb9de98-2d23-450a-87eb-bc618095a41a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:01.971152 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-afb9de98-2d23-450a-87eb-bc618095a41a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:02.120632 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-afb9de98-2d23-450a-87eb-bc618095a41a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:02.130068 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-afb9de98-2d23-450a-87eb-bc618095a41a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:02.131642 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-afb9de98-2d23-450a-87eb-bc618095a41a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:02.132811 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-afb9de98-2d23-450a-87eb-bc618095a41a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e" status: 200 len: 1741 microversion: 2.20 time: 0.178787 Aug 06 14:39:02.133441 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 508/966] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:39:01 2022] GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e => generated 1741 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:39:03.156084 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-7bbc78d7-50fc-4f25-8401-7e95ce639880 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:39:03.156682 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-7bbc78d7-50fc-4f25-8401-7e95ce639880 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:39:03.163016 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7bbc78d7-50fc-4f25-8401-7e95ce639880 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:03.163491 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7bbc78d7-50fc-4f25-8401-7e95ce639880 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:03.163918 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7bbc78d7-50fc-4f25-8401-7e95ce639880 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:03.164598 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7bbc78d7-50fc-4f25-8401-7e95ce639880 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:03.165045 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7bbc78d7-50fc-4f25-8401-7e95ce639880 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:03.165461 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7bbc78d7-50fc-4f25-8401-7e95ce639880 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:03.588937 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-7bbc78d7-50fc-4f25-8401-7e95ce639880 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:03.598476 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-7bbc78d7-50fc-4f25-8401-7e95ce639880 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:03.600005 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-7bbc78d7-50fc-4f25-8401-7e95ce639880 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:03.601160 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-7bbc78d7-50fc-4f25-8401-7e95ce639880 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e" status: 200 len: 1741 microversion: 2.20 time: 0.449486 Aug 06 14:39:03.601719 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 459/967] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:39:03 2022] GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e => generated 1741 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:39:04.624365 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-93fa621c-abb1-48a4-ba2a-281f9aaf9f4d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:39:04.624975 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-93fa621c-abb1-48a4-ba2a-281f9aaf9f4d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:39:04.631511 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-93fa621c-abb1-48a4-ba2a-281f9aaf9f4d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:04.631989 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-93fa621c-abb1-48a4-ba2a-281f9aaf9f4d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:04.632422 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-93fa621c-abb1-48a4-ba2a-281f9aaf9f4d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:04.633108 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-93fa621c-abb1-48a4-ba2a-281f9aaf9f4d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:04.633564 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-93fa621c-abb1-48a4-ba2a-281f9aaf9f4d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:04.633992 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-93fa621c-abb1-48a4-ba2a-281f9aaf9f4d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:04.758949 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-93fa621c-abb1-48a4-ba2a-281f9aaf9f4d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:04.767367 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-93fa621c-abb1-48a4-ba2a-281f9aaf9f4d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:04.768870 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-93fa621c-abb1-48a4-ba2a-281f9aaf9f4d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:04.770024 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-93fa621c-abb1-48a4-ba2a-281f9aaf9f4d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e" status: 200 len: 1723 microversion: 2.20 time: 0.149671 Aug 06 14:39:04.770579 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 509/968] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:39:04 2022] GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:39:05.793519 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-d076d05e-ba38-4e07-8dd6-eafbf9dab8ea tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:39:05.794116 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-d076d05e-ba38-4e07-8dd6-eafbf9dab8ea tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:39:05.801019 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d076d05e-ba38-4e07-8dd6-eafbf9dab8ea tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:05.801497 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d076d05e-ba38-4e07-8dd6-eafbf9dab8ea tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:05.801924 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d076d05e-ba38-4e07-8dd6-eafbf9dab8ea tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:05.802596 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d076d05e-ba38-4e07-8dd6-eafbf9dab8ea tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:05.803073 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d076d05e-ba38-4e07-8dd6-eafbf9dab8ea tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:05.803489 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d076d05e-ba38-4e07-8dd6-eafbf9dab8ea tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:05.937793 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-d076d05e-ba38-4e07-8dd6-eafbf9dab8ea tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:05.945795 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-d076d05e-ba38-4e07-8dd6-eafbf9dab8ea tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:05.947333 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-d076d05e-ba38-4e07-8dd6-eafbf9dab8ea tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:05.948486 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-d076d05e-ba38-4e07-8dd6-eafbf9dab8ea tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e" status: 200 len: 1723 microversion: 2.20 time: 0.158912 Aug 06 14:39:05.949048 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 460/969] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:39:05 2022] GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:39:06.971175 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-9293ecc5-3f91-4a3f-b7fb-721d6f287924 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:39:06.971784 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-9293ecc5-3f91-4a3f-b7fb-721d6f287924 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:39:06.978276 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9293ecc5-3f91-4a3f-b7fb-721d6f287924 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:06.978753 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9293ecc5-3f91-4a3f-b7fb-721d6f287924 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:06.979217 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9293ecc5-3f91-4a3f-b7fb-721d6f287924 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:06.979900 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9293ecc5-3f91-4a3f-b7fb-721d6f287924 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:06.980348 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9293ecc5-3f91-4a3f-b7fb-721d6f287924 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:06.980770 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9293ecc5-3f91-4a3f-b7fb-721d6f287924 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:06.985356 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_cell1:SELECT=100 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:39:07.110258 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-9293ecc5-3f91-4a3f-b7fb-721d6f287924 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:07.118593 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-9293ecc5-3f91-4a3f-b7fb-721d6f287924 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:07.119775 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-9293ecc5-3f91-4a3f-b7fb-721d6f287924 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:07.120951 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-9293ecc5-3f91-4a3f-b7fb-721d6f287924 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e" status: 200 len: 1723 microversion: 2.20 time: 0.153818 Aug 06 14:39:07.121505 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 510/970] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:39:06 2022] GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:39:08.145065 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-e3189fe7-2684-41c6-a05b-21716794f46d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:39:08.145675 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-e3189fe7-2684-41c6-a05b-21716794f46d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:39:08.152213 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e3189fe7-2684-41c6-a05b-21716794f46d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:08.152695 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e3189fe7-2684-41c6-a05b-21716794f46d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:08.153133 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e3189fe7-2684-41c6-a05b-21716794f46d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:08.153819 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e3189fe7-2684-41c6-a05b-21716794f46d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:08.154276 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e3189fe7-2684-41c6-a05b-21716794f46d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:08.154700 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e3189fe7-2684-41c6-a05b-21716794f46d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:08.281690 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-e3189fe7-2684-41c6-a05b-21716794f46d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:08.289744 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-e3189fe7-2684-41c6-a05b-21716794f46d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:08.291287 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-e3189fe7-2684-41c6-a05b-21716794f46d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:08.296592 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-e3189fe7-2684-41c6-a05b-21716794f46d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e" status: 200 len: 1723 microversion: 2.20 time: 0.151305 Aug 06 14:39:08.296592 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 461/971] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:39:08 2022] GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:39:09.314957 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-ab112829-0458-475e-b0b6-41c1bb98548b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:39:09.315527 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-ab112829-0458-475e-b0b6-41c1bb98548b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:39:09.324354 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ab112829-0458-475e-b0b6-41c1bb98548b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:09.324354 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ab112829-0458-475e-b0b6-41c1bb98548b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:09.324354 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ab112829-0458-475e-b0b6-41c1bb98548b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:09.324354 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ab112829-0458-475e-b0b6-41c1bb98548b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:09.324661 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ab112829-0458-475e-b0b6-41c1bb98548b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:09.324661 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ab112829-0458-475e-b0b6-41c1bb98548b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:09.425378 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [req-0ff7cf23-051b-40ba-afd8-359da18e4f1c req-f99c68a3-26ec-476e-9fce-239968a8c8ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91e50552-3108-4fca-82ca-e299af40061e", "name": "network-vif-unplugged", "status": "completed", "tag": "d910f3cd-711d-43f7-8b9c-b79ca1e620bd"}]} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:39:09.436296 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-0ff7cf23-051b-40ba-afd8-359da18e4f1c req-f99c68a3-26ec-476e-9fce-239968a8c8ee service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:09.437054 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-0ff7cf23-051b-40ba-afd8-359da18e4f1c req-f99c68a3-26ec-476e-9fce-239968a8c8ee service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:09.437666 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-0ff7cf23-051b-40ba-afd8-359da18e4f1c req-f99c68a3-26ec-476e-9fce-239968a8c8ee service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:09.448743 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.compute.server_external_events [req-0ff7cf23-051b-40ba-afd8-359da18e4f1c req-f99c68a3-26ec-476e-9fce-239968a8c8ee service nova] Creating event network-vif-unplugged:d910f3cd-711d-43f7-8b9c-b79ca1e620bd for instance 91e50552-3108-4fca-82ca-e299af40061e on hv-cinder-85199 Aug 06 14:39:09.454322 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [req-0ff7cf23-051b-40ba-afd8-359da18e4f1c req-f99c68a3-26ec-476e-9fce-239968a8c8ee service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033279 Aug 06 14:39:09.455065 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 462/972] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:39:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 14:39:09.463381 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-ab112829-0458-475e-b0b6-41c1bb98548b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:09.472036 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-ab112829-0458-475e-b0b6-41c1bb98548b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:09.473567 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-ab112829-0458-475e-b0b6-41c1bb98548b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:09.474744 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-ab112829-0458-475e-b0b6-41c1bb98548b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e" status: 200 len: 1723 microversion: 2.20 time: 0.163880 Aug 06 14:39:09.475337 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 511/973] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:39:09 2022] GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:39:10.499354 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-dd7a3585-3d17-44bb-9532-458e51821e41 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:39:10.500063 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-dd7a3585-3d17-44bb-9532-458e51821e41 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:39:10.506919 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-dd7a3585-3d17-44bb-9532-458e51821e41 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:10.507267 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-dd7a3585-3d17-44bb-9532-458e51821e41 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:10.507749 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-dd7a3585-3d17-44bb-9532-458e51821e41 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:10.508821 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-dd7a3585-3d17-44bb-9532-458e51821e41 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:10.509571 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-dd7a3585-3d17-44bb-9532-458e51821e41 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:10.509985 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-dd7a3585-3d17-44bb-9532-458e51821e41 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:10.643272 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-dd7a3585-3d17-44bb-9532-458e51821e41 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:10.651428 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-dd7a3585-3d17-44bb-9532-458e51821e41 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:10.652927 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-dd7a3585-3d17-44bb-9532-458e51821e41 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:10.654591 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-dd7a3585-3d17-44bb-9532-458e51821e41 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e" status: 200 len: 1723 microversion: 2.20 time: 0.160694 Aug 06 14:39:10.655185 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 463/974] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:39:10 2022] GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:39:11.677797 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-8bb288ff-e732-42b2-99ee-e33c1f6ef464 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:39:11.678402 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-8bb288ff-e732-42b2-99ee-e33c1f6ef464 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:39:11.685746 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8bb288ff-e732-42b2-99ee-e33c1f6ef464 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:11.686246 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8bb288ff-e732-42b2-99ee-e33c1f6ef464 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:11.686674 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8bb288ff-e732-42b2-99ee-e33c1f6ef464 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:11.687381 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8bb288ff-e732-42b2-99ee-e33c1f6ef464 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:11.687833 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8bb288ff-e732-42b2-99ee-e33c1f6ef464 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:11.688252 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8bb288ff-e732-42b2-99ee-e33c1f6ef464 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:11.818597 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-8bb288ff-e732-42b2-99ee-e33c1f6ef464 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:11.826541 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-8bb288ff-e732-42b2-99ee-e33c1f6ef464 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:11.828082 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-8bb288ff-e732-42b2-99ee-e33c1f6ef464 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:11.829253 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-8bb288ff-e732-42b2-99ee-e33c1f6ef464 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e" status: 200 len: 1723 microversion: 2.20 time: 0.155573 Aug 06 14:39:11.829812 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 512/975] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:39:11 2022] GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:39:12.852242 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-4e599e43-3c5d-4017-8310-a48d6a55ef3a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:39:12.852859 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-4e599e43-3c5d-4017-8310-a48d6a55ef3a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:39:12.859058 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4e599e43-3c5d-4017-8310-a48d6a55ef3a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:12.859537 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4e599e43-3c5d-4017-8310-a48d6a55ef3a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:12.859972 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4e599e43-3c5d-4017-8310-a48d6a55ef3a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:12.860658 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4e599e43-3c5d-4017-8310-a48d6a55ef3a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:12.861113 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4e599e43-3c5d-4017-8310-a48d6a55ef3a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:12.861535 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4e599e43-3c5d-4017-8310-a48d6a55ef3a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:12.995125 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-4e599e43-3c5d-4017-8310-a48d6a55ef3a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:13.003561 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-4e599e43-3c5d-4017-8310-a48d6a55ef3a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:13.005045 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-4e599e43-3c5d-4017-8310-a48d6a55ef3a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:13.006183 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-4e599e43-3c5d-4017-8310-a48d6a55ef3a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e" status: 200 len: 1726 microversion: 2.20 time: 0.157896 Aug 06 14:39:13.006729 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 464/976] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:39:12 2022] GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:39:13.028348 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-b6b40775-8281-4092-91d6-73218f4bbee7 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2bdf5725-458f-4795-88bd-a24e188bf5a7"}} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:39:13.030673 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-b6b40775-8281-4092-91d6-73218f4bbee7 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:39:13.036904 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b6b40775-8281-4092-91d6-73218f4bbee7 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:13.037379 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b6b40775-8281-4092-91d6-73218f4bbee7 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:13.037810 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b6b40775-8281-4092-91d6-73218f4bbee7 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:13.038485 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b6b40775-8281-4092-91d6-73218f4bbee7 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:13.038959 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b6b40775-8281-4092-91d6-73218f4bbee7 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:13.039381 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b6b40775-8281-4092-91d6-73218f4bbee7 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:13.297632 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-b6b40775-8281-4092-91d6-73218f4bbee7 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "POST /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.273067 Aug 06 14:39:13.298291 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 513/977] 10.222.0.17 () {62 vars in 1364 bytes} [Sat Aug 6 14:39:13 2022] POST /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e/os-volume_attachments => generated 188 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 06 14:39:13.416183 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-d95c9e74-cb8e-45a7-a5be-8331f212fa8b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:39:13.416667 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-d95c9e74-cb8e-45a7-a5be-8331f212fa8b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:39:13.423191 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d95c9e74-cb8e-45a7-a5be-8331f212fa8b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:13.423668 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d95c9e74-cb8e-45a7-a5be-8331f212fa8b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:13.424094 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d95c9e74-cb8e-45a7-a5be-8331f212fa8b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:13.424775 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d95c9e74-cb8e-45a7-a5be-8331f212fa8b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:13.425220 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d95c9e74-cb8e-45a7-a5be-8331f212fa8b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:13.425631 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d95c9e74-cb8e-45a7-a5be-8331f212fa8b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:14.824100 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-d95c9e74-cb8e-45a7-a5be-8331f212fa8b tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "DELETE /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e/os-volume_attachments/2bdf5725-458f-4795-88bd-a24e188bf5a7" status: 202 len: 0 microversion: 2.20 time: 1.411640 Aug 06 14:39:14.825288 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 465/978] 10.222.0.17 () {60 vars in 1457 bytes} [Sat Aug 6 14:39:13 2022] DELETE /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e/os-volume_attachments/2bdf5725-458f-4795-88bd-a24e188bf5a7 => generated 0 bytes in 1413 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 06 14:39:14.891359 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-ac252d29-28a0-4ae0-878d-47f1f3d72fa5 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:39:14.891959 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-ac252d29-28a0-4ae0-878d-47f1f3d72fa5 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:39:14.898851 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ac252d29-28a0-4ae0-878d-47f1f3d72fa5 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:14.899366 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ac252d29-28a0-4ae0-878d-47f1f3d72fa5 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:14.899796 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ac252d29-28a0-4ae0-878d-47f1f3d72fa5 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:14.900497 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ac252d29-28a0-4ae0-878d-47f1f3d72fa5 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:14.900948 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ac252d29-28a0-4ae0-878d-47f1f3d72fa5 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:14.901376 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ac252d29-28a0-4ae0-878d-47f1f3d72fa5 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:14.943616 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-ac252d29-28a0-4ae0-878d-47f1f3d72fa5 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117837) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 06 14:39:15.008240 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-ac252d29-28a0-4ae0-878d-47f1f3d72fa5 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "POST /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e/action" status: 202 len: 0 microversion: 2.20 time: 0.120901 Aug 06 14:39:15.009077 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 514/979] 10.222.0.17 () {62 vars in 1319 bytes} [Sat Aug 6 14:39:14 2022] POST /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 06 14:39:15.016857 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-9b2fb781-edd9-40ea-bfe9-c40c7a7e74e9 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:39:15.017475 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-9b2fb781-edd9-40ea-bfe9-c40c7a7e74e9 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:39:15.024361 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9b2fb781-edd9-40ea-bfe9-c40c7a7e74e9 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:15.024828 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9b2fb781-edd9-40ea-bfe9-c40c7a7e74e9 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:15.025264 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9b2fb781-edd9-40ea-bfe9-c40c7a7e74e9 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:15.025955 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9b2fb781-edd9-40ea-bfe9-c40c7a7e74e9 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:15.026410 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9b2fb781-edd9-40ea-bfe9-c40c7a7e74e9 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:15.026830 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9b2fb781-edd9-40ea-bfe9-c40c7a7e74e9 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:15.031418 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:39:15.183745 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-9b2fb781-edd9-40ea-bfe9-c40c7a7e74e9 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:15.201954 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-9b2fb781-edd9-40ea-bfe9-c40c7a7e74e9 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:15.203772 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-9b2fb781-edd9-40ea-bfe9-c40c7a7e74e9 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:15.204954 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-9b2fb781-edd9-40ea-bfe9-c40c7a7e74e9 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e" status: 200 len: 1734 microversion: 2.20 time: 0.191972 Aug 06 14:39:15.205694 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 466/980] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:39:15 2022] GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e => generated 1734 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:39:16.228968 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-9890d54c-7c08-48df-9e99-793790a7e8dc tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:39:16.229569 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-9890d54c-7c08-48df-9e99-793790a7e8dc tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:39:16.236139 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9890d54c-7c08-48df-9e99-793790a7e8dc tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:16.236623 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9890d54c-7c08-48df-9e99-793790a7e8dc tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:16.237256 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9890d54c-7c08-48df-9e99-793790a7e8dc tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:16.237936 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9890d54c-7c08-48df-9e99-793790a7e8dc tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:16.238387 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9890d54c-7c08-48df-9e99-793790a7e8dc tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:16.238817 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9890d54c-7c08-48df-9e99-793790a7e8dc tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:16.388889 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-9890d54c-7c08-48df-9e99-793790a7e8dc tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:16.397154 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-9890d54c-7c08-48df-9e99-793790a7e8dc tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:16.398786 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-9890d54c-7c08-48df-9e99-793790a7e8dc tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:16.400257 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-9890d54c-7c08-48df-9e99-793790a7e8dc tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e" status: 200 len: 1676 microversion: 2.20 time: 0.175670 Aug 06 14:39:16.400921 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 515/981] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:39:16 2022] GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e => generated 1676 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:39:17.423222 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-a3c75d95-8ec8-471b-a3e7-30001ef44da8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:39:17.423835 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-a3c75d95-8ec8-471b-a3e7-30001ef44da8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:39:17.430360 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a3c75d95-8ec8-471b-a3e7-30001ef44da8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:17.430836 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a3c75d95-8ec8-471b-a3e7-30001ef44da8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:17.431426 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a3c75d95-8ec8-471b-a3e7-30001ef44da8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:17.432063 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a3c75d95-8ec8-471b-a3e7-30001ef44da8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:17.432729 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a3c75d95-8ec8-471b-a3e7-30001ef44da8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:17.433144 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a3c75d95-8ec8-471b-a3e7-30001ef44da8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:17.593405 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-a3c75d95-8ec8-471b-a3e7-30001ef44da8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:17.601722 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-a3c75d95-8ec8-471b-a3e7-30001ef44da8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:17.603240 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-a3c75d95-8ec8-471b-a3e7-30001ef44da8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:17.604385 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-a3c75d95-8ec8-471b-a3e7-30001ef44da8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e" status: 200 len: 1732 microversion: 2.20 time: 0.185178 Aug 06 14:39:17.604936 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 467/982] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:39:17 2022] GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e => generated 1732 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:39:18.628054 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-38ea8d16-5c08-4cab-9e90-e9c165e4fde1 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:39:18.629475 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-38ea8d16-5c08-4cab-9e90-e9c165e4fde1 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:39:18.636073 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-38ea8d16-5c08-4cab-9e90-e9c165e4fde1 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:18.636562 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-38ea8d16-5c08-4cab-9e90-e9c165e4fde1 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:18.637051 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-38ea8d16-5c08-4cab-9e90-e9c165e4fde1 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:18.638340 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-38ea8d16-5c08-4cab-9e90-e9c165e4fde1 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:18.638800 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-38ea8d16-5c08-4cab-9e90-e9c165e4fde1 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:18.639257 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-38ea8d16-5c08-4cab-9e90-e9c165e4fde1 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:18.773315 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-38ea8d16-5c08-4cab-9e90-e9c165e4fde1 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:18.782026 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-38ea8d16-5c08-4cab-9e90-e9c165e4fde1 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:18.783550 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-38ea8d16-5c08-4cab-9e90-e9c165e4fde1 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:18.784714 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-38ea8d16-5c08-4cab-9e90-e9c165e4fde1 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e" status: 200 len: 1732 microversion: 2.20 time: 0.160557 Aug 06 14:39:18.785264 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 516/983] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:39:18 2022] GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:39:19.808373 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-1594f0cc-8aca-4731-8e7c-80bf6a308c12 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:39:19.809469 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-1594f0cc-8aca-4731-8e7c-80bf6a308c12 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:39:19.818350 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1594f0cc-8aca-4731-8e7c-80bf6a308c12 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:19.818840 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1594f0cc-8aca-4731-8e7c-80bf6a308c12 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:19.819292 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1594f0cc-8aca-4731-8e7c-80bf6a308c12 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:19.820130 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1594f0cc-8aca-4731-8e7c-80bf6a308c12 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:19.820785 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1594f0cc-8aca-4731-8e7c-80bf6a308c12 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:19.821259 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1594f0cc-8aca-4731-8e7c-80bf6a308c12 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:19.968166 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-1594f0cc-8aca-4731-8e7c-80bf6a308c12 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:19.983192 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-1594f0cc-8aca-4731-8e7c-80bf6a308c12 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:19.984726 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-1594f0cc-8aca-4731-8e7c-80bf6a308c12 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:19.985964 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-1594f0cc-8aca-4731-8e7c-80bf6a308c12 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e" status: 200 len: 1732 microversion: 2.20 time: 0.182213 Aug 06 14:39:19.986522 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 468/984] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:39:19 2022] GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e => generated 1732 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:39:21.014896 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-91c44e41-3b92-4ba8-81f3-621034ceeda8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:39:21.015683 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-91c44e41-3b92-4ba8-81f3-621034ceeda8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:39:21.022842 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-91c44e41-3b92-4ba8-81f3-621034ceeda8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:21.023585 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-91c44e41-3b92-4ba8-81f3-621034ceeda8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:21.024554 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-91c44e41-3b92-4ba8-81f3-621034ceeda8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:21.025684 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-91c44e41-3b92-4ba8-81f3-621034ceeda8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:21.027245 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-91c44e41-3b92-4ba8-81f3-621034ceeda8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:21.027996 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-91c44e41-3b92-4ba8-81f3-621034ceeda8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:21.229022 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-91c44e41-3b92-4ba8-81f3-621034ceeda8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:21.238736 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-91c44e41-3b92-4ba8-81f3-621034ceeda8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:21.241881 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-91c44e41-3b92-4ba8-81f3-621034ceeda8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:21.243710 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-91c44e41-3b92-4ba8-81f3-621034ceeda8 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e" status: 200 len: 1732 microversion: 2.20 time: 0.233790 Aug 06 14:39:21.244688 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 517/985] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:39:21 2022] GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e => generated 1732 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:39:22.268221 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-3f0c62ed-3af3-4e9a-b9a7-24f28d369d6d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:39:22.268863 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-3f0c62ed-3af3-4e9a-b9a7-24f28d369d6d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:39:22.275597 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3f0c62ed-3af3-4e9a-b9a7-24f28d369d6d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:22.276088 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3f0c62ed-3af3-4e9a-b9a7-24f28d369d6d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:22.276523 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3f0c62ed-3af3-4e9a-b9a7-24f28d369d6d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:22.277230 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3f0c62ed-3af3-4e9a-b9a7-24f28d369d6d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:22.277688 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3f0c62ed-3af3-4e9a-b9a7-24f28d369d6d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:22.278118 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3f0c62ed-3af3-4e9a-b9a7-24f28d369d6d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:22.439015 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-3f0c62ed-3af3-4e9a-b9a7-24f28d369d6d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:22.447636 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-3f0c62ed-3af3-4e9a-b9a7-24f28d369d6d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:22.449137 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-3f0c62ed-3af3-4e9a-b9a7-24f28d369d6d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:22.450333 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-3f0c62ed-3af3-4e9a-b9a7-24f28d369d6d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e" status: 200 len: 1732 microversion: 2.20 time: 0.186668 Aug 06 14:39:22.450931 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 469/986] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:39:22 2022] GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e => generated 1732 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:39:23.473743 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-2f19773d-e268-4059-b047-18fa2cdce594 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:39:23.474488 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-2f19773d-e268-4059-b047-18fa2cdce594 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:39:23.481136 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2f19773d-e268-4059-b047-18fa2cdce594 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:23.481625 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2f19773d-e268-4059-b047-18fa2cdce594 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:23.482062 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2f19773d-e268-4059-b047-18fa2cdce594 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:23.482767 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2f19773d-e268-4059-b047-18fa2cdce594 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:23.483256 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2f19773d-e268-4059-b047-18fa2cdce594 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:23.483684 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2f19773d-e268-4059-b047-18fa2cdce594 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:23.625575 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-2f19773d-e268-4059-b047-18fa2cdce594 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:23.634062 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-2f19773d-e268-4059-b047-18fa2cdce594 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:23.635658 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-2f19773d-e268-4059-b047-18fa2cdce594 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:23.636989 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-2f19773d-e268-4059-b047-18fa2cdce594 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e" status: 200 len: 1732 microversion: 2.20 time: 0.167222 Aug 06 14:39:23.637579 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 518/987] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:39:23 2022] GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e => generated 1732 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:39:24.661133 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-9a719cab-30ed-4bd2-afbd-89d1db0a1682 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:39:24.661866 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-9a719cab-30ed-4bd2-afbd-89d1db0a1682 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:39:24.668603 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9a719cab-30ed-4bd2-afbd-89d1db0a1682 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:24.669087 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9a719cab-30ed-4bd2-afbd-89d1db0a1682 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:24.669525 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9a719cab-30ed-4bd2-afbd-89d1db0a1682 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:24.670224 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9a719cab-30ed-4bd2-afbd-89d1db0a1682 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:24.670683 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9a719cab-30ed-4bd2-afbd-89d1db0a1682 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:24.671136 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9a719cab-30ed-4bd2-afbd-89d1db0a1682 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:24.814042 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-9a719cab-30ed-4bd2-afbd-89d1db0a1682 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:24.822555 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-9a719cab-30ed-4bd2-afbd-89d1db0a1682 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:24.823894 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-9a719cab-30ed-4bd2-afbd-89d1db0a1682 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:24.825932 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-9a719cab-30ed-4bd2-afbd-89d1db0a1682 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e" status: 200 len: 1732 microversion: 2.20 time: 0.167946 Aug 06 14:39:24.835599 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 470/988] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:39:24 2022] GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e => generated 1732 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:39:25.856203 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-337374fd-ca55-49ac-8237-f25aaa60e937 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:39:25.856819 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-337374fd-ca55-49ac-8237-f25aaa60e937 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:39:25.863766 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-337374fd-ca55-49ac-8237-f25aaa60e937 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:25.864252 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-337374fd-ca55-49ac-8237-f25aaa60e937 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:25.864685 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-337374fd-ca55-49ac-8237-f25aaa60e937 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:25.865388 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-337374fd-ca55-49ac-8237-f25aaa60e937 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:25.865901 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-337374fd-ca55-49ac-8237-f25aaa60e937 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:25.866266 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-337374fd-ca55-49ac-8237-f25aaa60e937 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:26.012112 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-337374fd-ca55-49ac-8237-f25aaa60e937 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:26.034313 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-337374fd-ca55-49ac-8237-f25aaa60e937 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:26.036046 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-337374fd-ca55-49ac-8237-f25aaa60e937 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:26.037297 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-337374fd-ca55-49ac-8237-f25aaa60e937 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e" status: 200 len: 1732 microversion: 2.20 time: 0.185315 Aug 06 14:39:26.037936 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 519/989] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:39:25 2022] GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e => generated 1732 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:39:27.061402 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-ac737c99-063a-43ab-8c54-3182b93e3284 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:39:27.062000 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-ac737c99-063a-43ab-8c54-3182b93e3284 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:39:27.068636 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ac737c99-063a-43ab-8c54-3182b93e3284 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:27.069192 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ac737c99-063a-43ab-8c54-3182b93e3284 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:27.069865 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ac737c99-063a-43ab-8c54-3182b93e3284 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:27.070568 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ac737c99-063a-43ab-8c54-3182b93e3284 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:27.071043 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ac737c99-063a-43ab-8c54-3182b93e3284 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:27.071469 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ac737c99-063a-43ab-8c54-3182b93e3284 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:27.216413 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-ac737c99-063a-43ab-8c54-3182b93e3284 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:27.225029 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-ac737c99-063a-43ab-8c54-3182b93e3284 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:27.226519 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-ac737c99-063a-43ab-8c54-3182b93e3284 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:27.227700 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-ac737c99-063a-43ab-8c54-3182b93e3284 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e" status: 200 len: 1732 microversion: 2.20 time: 0.171153 Aug 06 14:39:27.228249 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 471/990] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:39:27 2022] GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e => generated 1732 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:39:28.249847 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-7b2a9fec-720e-46d0-98ba-2490b50e40df tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:39:28.250441 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-7b2a9fec-720e-46d0-98ba-2490b50e40df tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:39:28.256837 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7b2a9fec-720e-46d0-98ba-2490b50e40df tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:28.257349 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7b2a9fec-720e-46d0-98ba-2490b50e40df tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:28.257773 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7b2a9fec-720e-46d0-98ba-2490b50e40df tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:28.258444 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7b2a9fec-720e-46d0-98ba-2490b50e40df tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:28.258902 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7b2a9fec-720e-46d0-98ba-2490b50e40df tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:28.259321 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7b2a9fec-720e-46d0-98ba-2490b50e40df tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:28.386517 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-7b2a9fec-720e-46d0-98ba-2490b50e40df tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:28.395051 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-7b2a9fec-720e-46d0-98ba-2490b50e40df tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:28.396550 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-7b2a9fec-720e-46d0-98ba-2490b50e40df tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:28.397707 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-7b2a9fec-720e-46d0-98ba-2490b50e40df tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e" status: 200 len: 1732 microversion: 2.20 time: 0.151795 Aug 06 14:39:28.398265 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 520/991] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:39:28 2022] GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:39:29.422020 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-8bb2182c-cdbd-4953-88d9-f0b8dae09764 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:39:29.422638 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-8bb2182c-cdbd-4953-88d9-f0b8dae09764 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:39:29.425017 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_api:SELECT=32 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:39:29.430230 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8bb2182c-cdbd-4953-88d9-f0b8dae09764 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:29.430710 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8bb2182c-cdbd-4953-88d9-f0b8dae09764 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:29.431168 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8bb2182c-cdbd-4953-88d9-f0b8dae09764 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:29.431861 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8bb2182c-cdbd-4953-88d9-f0b8dae09764 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:29.432557 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8bb2182c-cdbd-4953-88d9-f0b8dae09764 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:29.432988 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8bb2182c-cdbd-4953-88d9-f0b8dae09764 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:29.566535 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-8bb2182c-cdbd-4953-88d9-f0b8dae09764 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:29.574367 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-8bb2182c-cdbd-4953-88d9-f0b8dae09764 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:29.575920 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-8bb2182c-cdbd-4953-88d9-f0b8dae09764 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:29.577108 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-8bb2182c-cdbd-4953-88d9-f0b8dae09764 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e" status: 200 len: 1732 microversion: 2.20 time: 0.159884 Aug 06 14:39:29.577662 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 472/992] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:39:29 2022] GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:39:30.599858 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-1558ce5c-09a2-4274-ae5e-3b0059cdbb72 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:39:30.600451 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-1558ce5c-09a2-4274-ae5e-3b0059cdbb72 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:39:30.602974 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:39:30.609379 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1558ce5c-09a2-4274-ae5e-3b0059cdbb72 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:30.609852 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1558ce5c-09a2-4274-ae5e-3b0059cdbb72 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:30.610280 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1558ce5c-09a2-4274-ae5e-3b0059cdbb72 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:30.610982 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1558ce5c-09a2-4274-ae5e-3b0059cdbb72 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:30.611433 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1558ce5c-09a2-4274-ae5e-3b0059cdbb72 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:30.611849 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1558ce5c-09a2-4274-ae5e-3b0059cdbb72 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:30.739249 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-1558ce5c-09a2-4274-ae5e-3b0059cdbb72 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:30.747088 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-1558ce5c-09a2-4274-ae5e-3b0059cdbb72 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:30.748590 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-1558ce5c-09a2-4274-ae5e-3b0059cdbb72 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:30.750330 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-1558ce5c-09a2-4274-ae5e-3b0059cdbb72 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e" status: 200 len: 1732 microversion: 2.20 time: 0.155379 Aug 06 14:39:30.750902 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 521/993] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:39:30 2022] GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:39:31.772902 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-bb7964d0-cf4a-4265-8d35-e332ffc9ed5e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:39:31.773501 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-bb7964d0-cf4a-4265-8d35-e332ffc9ed5e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:39:31.780509 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-bb7964d0-cf4a-4265-8d35-e332ffc9ed5e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:31.780992 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-bb7964d0-cf4a-4265-8d35-e332ffc9ed5e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:31.781417 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-bb7964d0-cf4a-4265-8d35-e332ffc9ed5e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:31.782099 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-bb7964d0-cf4a-4265-8d35-e332ffc9ed5e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:31.782546 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-bb7964d0-cf4a-4265-8d35-e332ffc9ed5e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:31.782991 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-bb7964d0-cf4a-4265-8d35-e332ffc9ed5e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:31.919825 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-bb7964d0-cf4a-4265-8d35-e332ffc9ed5e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:31.928354 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-bb7964d0-cf4a-4265-8d35-e332ffc9ed5e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:31.929835 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-bb7964d0-cf4a-4265-8d35-e332ffc9ed5e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:31.931010 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-bb7964d0-cf4a-4265-8d35-e332ffc9ed5e tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e" status: 200 len: 1732 microversion: 2.20 time: 0.162055 Aug 06 14:39:31.931558 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 473/994] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:39:31 2022] GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:39:32.953603 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-dcb317b4-e3d9-4350-8925-20c788016184 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:39:32.954202 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-dcb317b4-e3d9-4350-8925-20c788016184 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:39:32.960240 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-dcb317b4-e3d9-4350-8925-20c788016184 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:32.960716 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-dcb317b4-e3d9-4350-8925-20c788016184 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:32.961147 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-dcb317b4-e3d9-4350-8925-20c788016184 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:32.961826 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-dcb317b4-e3d9-4350-8925-20c788016184 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:32.962273 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-dcb317b4-e3d9-4350-8925-20c788016184 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:32.962692 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-dcb317b4-e3d9-4350-8925-20c788016184 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:33.086784 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-dcb317b4-e3d9-4350-8925-20c788016184 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:33.094569 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-dcb317b4-e3d9-4350-8925-20c788016184 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:33.096104 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-dcb317b4-e3d9-4350-8925-20c788016184 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:33.097262 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-dcb317b4-e3d9-4350-8925-20c788016184 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e" status: 200 len: 1732 microversion: 2.20 time: 0.147553 Aug 06 14:39:33.097865 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 522/995] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:39:32 2022] GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e => generated 1732 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:39:34.120608 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-6ed159da-7059-4942-b099-dcdf20bc71d2 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:39:34.121217 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-6ed159da-7059-4942-b099-dcdf20bc71d2 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:39:34.128178 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6ed159da-7059-4942-b099-dcdf20bc71d2 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:34.128658 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6ed159da-7059-4942-b099-dcdf20bc71d2 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:34.129090 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6ed159da-7059-4942-b099-dcdf20bc71d2 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:34.129774 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6ed159da-7059-4942-b099-dcdf20bc71d2 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:34.130227 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6ed159da-7059-4942-b099-dcdf20bc71d2 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:34.130649 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6ed159da-7059-4942-b099-dcdf20bc71d2 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:34.259936 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-6ed159da-7059-4942-b099-dcdf20bc71d2 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:34.268513 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-6ed159da-7059-4942-b099-dcdf20bc71d2 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:34.270013 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-6ed159da-7059-4942-b099-dcdf20bc71d2 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:34.271199 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-6ed159da-7059-4942-b099-dcdf20bc71d2 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e" status: 200 len: 1732 microversion: 2.20 time: 0.154481 Aug 06 14:39:34.271755 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 474/996] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:39:34 2022] GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:39:35.293685 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-7e946f00-e8b5-491f-8aa3-e5d9c90c650f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:39:35.294292 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-7e946f00-e8b5-491f-8aa3-e5d9c90c650f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:39:35.300742 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7e946f00-e8b5-491f-8aa3-e5d9c90c650f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:35.301224 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7e946f00-e8b5-491f-8aa3-e5d9c90c650f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:35.301666 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7e946f00-e8b5-491f-8aa3-e5d9c90c650f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:35.302351 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7e946f00-e8b5-491f-8aa3-e5d9c90c650f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:35.302804 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7e946f00-e8b5-491f-8aa3-e5d9c90c650f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:35.303273 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7e946f00-e8b5-491f-8aa3-e5d9c90c650f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:35.307118 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:39:35.434372 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-7e946f00-e8b5-491f-8aa3-e5d9c90c650f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:35.442265 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-7e946f00-e8b5-491f-8aa3-e5d9c90c650f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:35.443794 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-7e946f00-e8b5-491f-8aa3-e5d9c90c650f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:35.444953 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-7e946f00-e8b5-491f-8aa3-e5d9c90c650f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e" status: 200 len: 1732 microversion: 2.20 time: 0.155207 Aug 06 14:39:35.445512 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 523/997] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:39:35 2022] GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:39:36.468534 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-12b121aa-1884-4f16-80a2-f86cdab9834f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:39:36.469197 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-12b121aa-1884-4f16-80a2-f86cdab9834f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:39:36.475609 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-12b121aa-1884-4f16-80a2-f86cdab9834f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:36.476087 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-12b121aa-1884-4f16-80a2-f86cdab9834f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:36.476513 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-12b121aa-1884-4f16-80a2-f86cdab9834f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:36.477189 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-12b121aa-1884-4f16-80a2-f86cdab9834f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:36.477636 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-12b121aa-1884-4f16-80a2-f86cdab9834f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:36.478050 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-12b121aa-1884-4f16-80a2-f86cdab9834f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:36.604379 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-12b121aa-1884-4f16-80a2-f86cdab9834f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:36.612192 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-12b121aa-1884-4f16-80a2-f86cdab9834f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:36.613685 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-12b121aa-1884-4f16-80a2-f86cdab9834f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:36.614828 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-12b121aa-1884-4f16-80a2-f86cdab9834f tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e" status: 200 len: 1732 microversion: 2.20 time: 0.150728 Aug 06 14:39:36.615399 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 475/998] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:39:36 2022] GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:39:37.005593 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [req-29303197-f26c-4993-9322-c207574f962d req-a37d77b8-ef77-48b2-835f-823e95d7946d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91e50552-3108-4fca-82ca-e299af40061e", "name": "network-vif-plugged", "status": "completed", "tag": "d910f3cd-711d-43f7-8b9c-b79ca1e620bd"}]} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:39:37.017435 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-29303197-f26c-4993-9322-c207574f962d req-a37d77b8-ef77-48b2-835f-823e95d7946d service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:37.017939 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-29303197-f26c-4993-9322-c207574f962d req-a37d77b8-ef77-48b2-835f-823e95d7946d service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:37.018365 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-29303197-f26c-4993-9322-c207574f962d req-a37d77b8-ef77-48b2-835f-823e95d7946d service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:37.029653 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.compute.server_external_events [req-29303197-f26c-4993-9322-c207574f962d req-a37d77b8-ef77-48b2-835f-823e95d7946d service nova] Creating event network-vif-plugged:d910f3cd-711d-43f7-8b9c-b79ca1e620bd for instance 91e50552-3108-4fca-82ca-e299af40061e on hv-cinder-85199 Aug 06 14:39:37.034692 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [req-29303197-f26c-4993-9322-c207574f962d req-a37d77b8-ef77-48b2-835f-823e95d7946d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032943 Aug 06 14:39:37.035533 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 524/999] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:39:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:39:37.637019 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-b8ae37e5-fdda-4fb9-827e-084e467a14dd tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:39:37.637629 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-b8ae37e5-fdda-4fb9-827e-084e467a14dd tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:39:37.644060 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b8ae37e5-fdda-4fb9-827e-084e467a14dd tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:37.644572 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b8ae37e5-fdda-4fb9-827e-084e467a14dd tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:37.645012 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b8ae37e5-fdda-4fb9-827e-084e467a14dd tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:37.645702 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b8ae37e5-fdda-4fb9-827e-084e467a14dd tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:37.646160 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b8ae37e5-fdda-4fb9-827e-084e467a14dd tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:37.646587 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b8ae37e5-fdda-4fb9-827e-084e467a14dd tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:37.775382 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-b8ae37e5-fdda-4fb9-827e-084e467a14dd tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:37.783857 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-b8ae37e5-fdda-4fb9-827e-084e467a14dd tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:37.785362 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-b8ae37e5-fdda-4fb9-827e-084e467a14dd tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:37.786528 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-b8ae37e5-fdda-4fb9-827e-084e467a14dd tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e" status: 200 len: 1732 microversion: 2.20 time: 0.153515 Aug 06 14:39:37.787126 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 476/1000] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:39:37 2022] GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:39:38.810721 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-21a689cc-061f-4a7f-bb42-48963649834d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:39:38.811934 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-21a689cc-061f-4a7f-bb42-48963649834d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:39:38.818439 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-21a689cc-061f-4a7f-bb42-48963649834d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:38.818945 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-21a689cc-061f-4a7f-bb42-48963649834d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:38.819372 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-21a689cc-061f-4a7f-bb42-48963649834d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:38.820046 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-21a689cc-061f-4a7f-bb42-48963649834d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:38.820493 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-21a689cc-061f-4a7f-bb42-48963649834d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:38.820910 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-21a689cc-061f-4a7f-bb42-48963649834d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:38.955001 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-21a689cc-061f-4a7f-bb42-48963649834d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:38.962833 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-21a689cc-061f-4a7f-bb42-48963649834d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:38.964338 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-21a689cc-061f-4a7f-bb42-48963649834d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:38.965480 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-21a689cc-061f-4a7f-bb42-48963649834d tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e" status: 200 len: 1732 microversion: 2.20 time: 0.159323 Aug 06 14:39:38.966031 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 525/1001] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:39:38 2022] GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:39:39.988335 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-fcec8d9e-eadb-46dc-9b3b-159035242dde tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:39:39.988976 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-fcec8d9e-eadb-46dc-9b3b-159035242dde tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:39:39.995669 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-fcec8d9e-eadb-46dc-9b3b-159035242dde tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:39.996207 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-fcec8d9e-eadb-46dc-9b3b-159035242dde tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:39.996644 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-fcec8d9e-eadb-46dc-9b3b-159035242dde tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:39.997379 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-fcec8d9e-eadb-46dc-9b3b-159035242dde tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:39.997887 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-fcec8d9e-eadb-46dc-9b3b-159035242dde tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:39.998823 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-fcec8d9e-eadb-46dc-9b3b-159035242dde tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:40.133023 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-fcec8d9e-eadb-46dc-9b3b-159035242dde tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:40.141707 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-fcec8d9e-eadb-46dc-9b3b-159035242dde tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:40.143214 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-fcec8d9e-eadb-46dc-9b3b-159035242dde tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:40.144364 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-fcec8d9e-eadb-46dc-9b3b-159035242dde tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e" status: 200 len: 1732 microversion: 2.20 time: 0.160043 Aug 06 14:39:40.144916 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 477/1002] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:39:39 2022] GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:39:41.167426 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-0cce36ff-4454-4a6b-ac3b-6aec94c1e906 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:39:41.168038 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-0cce36ff-4454-4a6b-ac3b-6aec94c1e906 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:39:41.174479 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0cce36ff-4454-4a6b-ac3b-6aec94c1e906 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:41.174995 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0cce36ff-4454-4a6b-ac3b-6aec94c1e906 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:41.175431 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0cce36ff-4454-4a6b-ac3b-6aec94c1e906 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:41.176133 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0cce36ff-4454-4a6b-ac3b-6aec94c1e906 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:41.176590 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0cce36ff-4454-4a6b-ac3b-6aec94c1e906 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:41.177017 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0cce36ff-4454-4a6b-ac3b-6aec94c1e906 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:41.305818 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-0cce36ff-4454-4a6b-ac3b-6aec94c1e906 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:41.314003 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-0cce36ff-4454-4a6b-ac3b-6aec94c1e906 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:41.315545 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-0cce36ff-4454-4a6b-ac3b-6aec94c1e906 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:39:41.316701 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-0cce36ff-4454-4a6b-ac3b-6aec94c1e906 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e" status: 200 len: 1719 microversion: 2.20 time: 0.153184 Aug 06 14:39:41.317261 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 526/1003] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:39:41 2022] GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e => generated 1719 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:39:47.494125 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-2abd857c-22f0-477e-9807-1c088067e2b4 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:39:47.494709 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-2abd857c-22f0-477e-9807-1c088067e2b4 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8cd3b906-abcb-4669-9d1b-0dd3133ec23e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:39:47.501278 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2abd857c-22f0-477e-9807-1c088067e2b4 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:47.501753 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2abd857c-22f0-477e-9807-1c088067e2b4 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:47.502179 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2abd857c-22f0-477e-9807-1c088067e2b4 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:47.502854 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2abd857c-22f0-477e-9807-1c088067e2b4 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:47.503321 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2abd857c-22f0-477e-9807-1c088067e2b4 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:47.503738 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2abd857c-22f0-477e-9807-1c088067e2b4 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:47.506033 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_cell1:SELECT=72 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:39:47.527524 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-2abd857c-22f0-477e-9807-1c088067e2b4 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8cd3b906-abcb-4669-9d1b-0dd3133ec23e/ips" status: 200 len: 145 microversion: 2.1 time: 0.037256 Aug 06 14:39:47.528067 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 478/1004] 10.222.0.17 () {58 vars in 1248 bytes} [Sat Aug 6 14:39:47 2022] GET /compute/v2.1/servers/8cd3b906-abcb-4669-9d1b-0dd3133ec23e/ips => generated 145 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:39:48.850072 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-bd0d2bed-888c-426a-83dd-07e0c2b2e9b1 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "883d3fdd-a6e2-400d-8b89-48b89493c900"}} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:39:48.852439 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-bd0d2bed-888c-426a-83dd-07e0c2b2e9b1 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8cd3b906-abcb-4669-9d1b-0dd3133ec23e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:39:48.859325 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-bd0d2bed-888c-426a-83dd-07e0c2b2e9b1 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:48.859808 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-bd0d2bed-888c-426a-83dd-07e0c2b2e9b1 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:48.860245 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-bd0d2bed-888c-426a-83dd-07e0c2b2e9b1 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:48.860937 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-bd0d2bed-888c-426a-83dd-07e0c2b2e9b1 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:48.861391 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-bd0d2bed-888c-426a-83dd-07e0c2b2e9b1 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:48.861810 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-bd0d2bed-888c-426a-83dd-07e0c2b2e9b1 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:49.284247 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-bd0d2bed-888c-426a-83dd-07e0c2b2e9b1 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "POST /compute/v2.1/servers/8cd3b906-abcb-4669-9d1b-0dd3133ec23e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.437982 Aug 06 14:39:49.284847 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 527/1005] 10.222.0.17 () {60 vars in 1323 bytes} [Sat Aug 6 14:39:48 2022] POST /compute/v2.1/servers/8cd3b906-abcb-4669-9d1b-0dd3133ec23e/os-volume_attachments => generated 194 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:39:56.792869 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-3f3aa181-2e89-4919-b886-c4f0ab2d0a4c tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:39:56.795137 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-3f3aa181-2e89-4919-b886-c4f0ab2d0a4c tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8cd3b906-abcb-4669-9d1b-0dd3133ec23e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:39:56.802109 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3f3aa181-2e89-4919-b886-c4f0ab2d0a4c tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:56.802616 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3f3aa181-2e89-4919-b886-c4f0ab2d0a4c tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:56.803082 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3f3aa181-2e89-4919-b886-c4f0ab2d0a4c tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:56.803763 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3f3aa181-2e89-4919-b886-c4f0ab2d0a4c tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:56.804211 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3f3aa181-2e89-4919-b886-c4f0ab2d0a4c tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:56.804633 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3f3aa181-2e89-4919-b886-c4f0ab2d0a4c tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:56.834755 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-3f3aa181-2e89-4919-b886-c4f0ab2d0a4c tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8cd3b906-abcb-4669-9d1b-0dd3133ec23e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045782 Aug 06 14:39:56.835340 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 479/1006] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Aug 6 14:39:56 2022] GET /compute/v2.1/servers/8cd3b906-abcb-4669-9d1b-0dd3133ec23e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:39:56.847107 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-7a416640-0d61-4272-a0c6-37a0c34ef2f0 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:39:56.848123 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-7a416640-0d61-4272-a0c6-37a0c34ef2f0 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8cd3b906-abcb-4669-9d1b-0dd3133ec23e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:39:56.854681 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7a416640-0d61-4272-a0c6-37a0c34ef2f0 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:56.855184 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7a416640-0d61-4272-a0c6-37a0c34ef2f0 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:56.855619 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7a416640-0d61-4272-a0c6-37a0c34ef2f0 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:56.856341 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7a416640-0d61-4272-a0c6-37a0c34ef2f0 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:56.856777 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7a416640-0d61-4272-a0c6-37a0c34ef2f0 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:56.857194 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7a416640-0d61-4272-a0c6-37a0c34ef2f0 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:56.888063 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-7a416640-0d61-4272-a0c6-37a0c34ef2f0 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8cd3b906-abcb-4669-9d1b-0dd3133ec23e/os-volume_attachments/883d3fdd-a6e2-400d-8b89-48b89493c900" status: 200 len: 194 microversion: 2.1 time: 0.046026 Aug 06 14:39:56.888640 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 528/1007] 10.222.0.17 () {58 vars in 1413 bytes} [Sat Aug 6 14:39:56 2022] GET /compute/v2.1/servers/8cd3b906-abcb-4669-9d1b-0dd3133ec23e/os-volume_attachments/883d3fdd-a6e2-400d-8b89-48b89493c900 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:39:58.205389 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-63647c0e-6ac7-4ca4-9cad-561045a9df1a tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f3e9a54d-4a43-480d-b737-251cd5485431"}} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:39:58.207951 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-63647c0e-6ac7-4ca4-9cad-561045a9df1a tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8cd3b906-abcb-4669-9d1b-0dd3133ec23e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:39:58.214270 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-63647c0e-6ac7-4ca4-9cad-561045a9df1a tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:58.214742 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-63647c0e-6ac7-4ca4-9cad-561045a9df1a tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:58.215206 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-63647c0e-6ac7-4ca4-9cad-561045a9df1a tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:58.215902 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-63647c0e-6ac7-4ca4-9cad-561045a9df1a tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:39:58.216329 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-63647c0e-6ac7-4ca4-9cad-561045a9df1a tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:39:58.216744 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-63647c0e-6ac7-4ca4-9cad-561045a9df1a tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:39:58.528395 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-63647c0e-6ac7-4ca4-9cad-561045a9df1a tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "POST /compute/v2.1/servers/8cd3b906-abcb-4669-9d1b-0dd3133ec23e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.326724 Aug 06 14:39:58.529169 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 480/1008] 10.222.0.17 () {60 vars in 1323 bytes} [Sat Aug 6 14:39:58 2022] POST /compute/v2.1/servers/8cd3b906-abcb-4669-9d1b-0dd3133ec23e/os-volume_attachments => generated 194 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:40:03.165537 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 14:40:03.166103 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Sat Aug 6 14:40:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 14:40:06.043632 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-2529fff0-de96-4282-881a-da6cc4de420e tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:40:06.046410 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-2529fff0-de96-4282-881a-da6cc4de420e tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8cd3b906-abcb-4669-9d1b-0dd3133ec23e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:40:06.048815 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_api:SELECT=16 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:40:06.054282 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2529fff0-de96-4282-881a-da6cc4de420e tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:06.054919 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2529fff0-de96-4282-881a-da6cc4de420e tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:06.055394 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2529fff0-de96-4282-881a-da6cc4de420e tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:06.056094 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2529fff0-de96-4282-881a-da6cc4de420e tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:06.056549 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2529fff0-de96-4282-881a-da6cc4de420e tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:06.057096 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2529fff0-de96-4282-881a-da6cc4de420e tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:06.062098 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:40:06.090085 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-2529fff0-de96-4282-881a-da6cc4de420e tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8cd3b906-abcb-4669-9d1b-0dd3133ec23e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050306 Aug 06 14:40:06.090679 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 529/1009] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Aug 6 14:40:06 2022] GET /compute/v2.1/servers/8cd3b906-abcb-4669-9d1b-0dd3133ec23e/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:40:06.235873 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-a1b0eada-1060-4645-a3c2-efd947f46a95 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:40:06.236428 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-a1b0eada-1060-4645-a3c2-efd947f46a95 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8cd3b906-abcb-4669-9d1b-0dd3133ec23e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:40:06.238855 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_api:SELECT=18 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:40:06.244814 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a1b0eada-1060-4645-a3c2-efd947f46a95 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:06.245304 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a1b0eada-1060-4645-a3c2-efd947f46a95 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:06.245735 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a1b0eada-1060-4645-a3c2-efd947f46a95 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:06.246439 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a1b0eada-1060-4645-a3c2-efd947f46a95 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:06.246908 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a1b0eada-1060-4645-a3c2-efd947f46a95 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:06.247335 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a1b0eada-1060-4645-a3c2-efd947f46a95 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:06.277980 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-a1b0eada-1060-4645-a3c2-efd947f46a95 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8cd3b906-abcb-4669-9d1b-0dd3133ec23e/os-volume_attachments/883d3fdd-a6e2-400d-8b89-48b89493c900" status: 200 len: 194 microversion: 2.1 time: 0.047267 Aug 06 14:40:06.278588 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 481/1010] 10.222.0.17 () {58 vars in 1413 bytes} [Sat Aug 6 14:40:06 2022] GET /compute/v2.1/servers/8cd3b906-abcb-4669-9d1b-0dd3133ec23e/os-volume_attachments/883d3fdd-a6e2-400d-8b89-48b89493c900 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 14:40:06.289539 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-f8ad8d3f-c260-4b56-bd68-dc6f67332495 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:40:06.290040 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-f8ad8d3f-c260-4b56-bd68-dc6f67332495 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8cd3b906-abcb-4669-9d1b-0dd3133ec23e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:40:06.296784 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f8ad8d3f-c260-4b56-bd68-dc6f67332495 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:06.298285 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f8ad8d3f-c260-4b56-bd68-dc6f67332495 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:06.298720 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f8ad8d3f-c260-4b56-bd68-dc6f67332495 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:06.299454 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f8ad8d3f-c260-4b56-bd68-dc6f67332495 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:06.299915 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f8ad8d3f-c260-4b56-bd68-dc6f67332495 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:06.300346 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f8ad8d3f-c260-4b56-bd68-dc6f67332495 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:06.384685 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.objects.instance [None req-f8ad8d3f-c260-4b56-bd68-dc6f67332495 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lazy-loading 'services' on Instance uuid 8cd3b906-abcb-4669-9d1b-0dd3133ec23e {{(pid=117837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 14:40:06.458264 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-f8ad8d3f-c260-4b56-bd68-dc6f67332495 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "DELETE /compute/v2.1/servers/8cd3b906-abcb-4669-9d1b-0dd3133ec23e/os-volume_attachments/883d3fdd-a6e2-400d-8b89-48b89493c900" status: 202 len: 0 microversion: 2.1 time: 0.172632 Aug 06 14:40:06.458861 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 530/1011] 10.222.0.17 () {58 vars in 1416 bytes} [Sat Aug 6 14:40:06 2022] DELETE /compute/v2.1/servers/8cd3b906-abcb-4669-9d1b-0dd3133ec23e/os-volume_attachments/883d3fdd-a6e2-400d-8b89-48b89493c900 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 14:40:08.633694 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-b2f5c2fa-f79c-494a-b4c0-df51254d661b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:40:08.634182 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-b2f5c2fa-f79c-494a-b4c0-df51254d661b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8cd3b906-abcb-4669-9d1b-0dd3133ec23e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:40:08.640581 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b2f5c2fa-f79c-494a-b4c0-df51254d661b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:08.641049 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b2f5c2fa-f79c-494a-b4c0-df51254d661b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:08.641476 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b2f5c2fa-f79c-494a-b4c0-df51254d661b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:08.642155 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b2f5c2fa-f79c-494a-b4c0-df51254d661b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:08.642604 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b2f5c2fa-f79c-494a-b4c0-df51254d661b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:08.643054 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b2f5c2fa-f79c-494a-b4c0-df51254d661b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:08.671587 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-b2f5c2fa-f79c-494a-b4c0-df51254d661b tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8cd3b906-abcb-4669-9d1b-0dd3133ec23e/os-volume_attachments/f3e9a54d-4a43-480d-b737-251cd5485431" status: 200 len: 194 microversion: 2.1 time: 0.041131 Aug 06 14:40:08.672142 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 482/1012] 10.222.0.17 () {58 vars in 1413 bytes} [Sat Aug 6 14:40:08 2022] GET /compute/v2.1/servers/8cd3b906-abcb-4669-9d1b-0dd3133ec23e/os-volume_attachments/f3e9a54d-4a43-480d-b737-251cd5485431 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:40:08.683235 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-9cd61f34-2ea3-42f7-b6ff-61a4b1c74608 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:40:08.683849 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-9cd61f34-2ea3-42f7-b6ff-61a4b1c74608 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8cd3b906-abcb-4669-9d1b-0dd3133ec23e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:40:08.690492 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9cd61f34-2ea3-42f7-b6ff-61a4b1c74608 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:08.691005 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9cd61f34-2ea3-42f7-b6ff-61a4b1c74608 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:08.691446 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9cd61f34-2ea3-42f7-b6ff-61a4b1c74608 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:08.692137 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9cd61f34-2ea3-42f7-b6ff-61a4b1c74608 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:08.692597 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9cd61f34-2ea3-42f7-b6ff-61a4b1c74608 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:08.693024 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9cd61f34-2ea3-42f7-b6ff-61a4b1c74608 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:08.772916 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.objects.instance [None req-9cd61f34-2ea3-42f7-b6ff-61a4b1c74608 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lazy-loading 'services' on Instance uuid 8cd3b906-abcb-4669-9d1b-0dd3133ec23e {{(pid=117837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 14:40:08.847552 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-9cd61f34-2ea3-42f7-b6ff-61a4b1c74608 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "DELETE /compute/v2.1/servers/8cd3b906-abcb-4669-9d1b-0dd3133ec23e/os-volume_attachments/f3e9a54d-4a43-480d-b737-251cd5485431" status: 202 len: 0 microversion: 2.1 time: 0.168130 Aug 06 14:40:08.851691 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 531/1013] 10.222.0.17 () {58 vars in 1416 bytes} [Sat Aug 6 14:40:08 2022] DELETE /compute/v2.1/servers/8cd3b906-abcb-4669-9d1b-0dd3133ec23e/os-volume_attachments/f3e9a54d-4a43-480d-b737-251cd5485431 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 14:40:10.012950 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-2876b449-7571-42d1-954c-d633a3887ff0 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:40:10.015200 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-2876b449-7571-42d1-954c-d633a3887ff0 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8cd3b906-abcb-4669-9d1b-0dd3133ec23e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:40:10.021477 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2876b449-7571-42d1-954c-d633a3887ff0 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:10.021961 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2876b449-7571-42d1-954c-d633a3887ff0 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:10.022404 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2876b449-7571-42d1-954c-d633a3887ff0 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:10.023126 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2876b449-7571-42d1-954c-d633a3887ff0 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:10.023585 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2876b449-7571-42d1-954c-d633a3887ff0 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:10.024012 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2876b449-7571-42d1-954c-d633a3887ff0 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:10.053488 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-2876b449-7571-42d1-954c-d633a3887ff0 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8cd3b906-abcb-4669-9d1b-0dd3133ec23e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044434 Aug 06 14:40:10.054032 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 483/1014] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Aug 6 14:40:10 2022] GET /compute/v2.1/servers/8cd3b906-abcb-4669-9d1b-0dd3133ec23e/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 14:40:10.163588 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-343fc486-6926-4ebe-9da3-46cc3028e0de tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:40:10.165944 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-343fc486-6926-4ebe-9da3-46cc3028e0de tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8cd3b906-abcb-4669-9d1b-0dd3133ec23e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:40:10.173207 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-343fc486-6926-4ebe-9da3-46cc3028e0de tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:10.173683 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-343fc486-6926-4ebe-9da3-46cc3028e0de tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:10.174115 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-343fc486-6926-4ebe-9da3-46cc3028e0de tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:10.174802 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-343fc486-6926-4ebe-9da3-46cc3028e0de tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:10.175285 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-343fc486-6926-4ebe-9da3-46cc3028e0de tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:10.175706 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-343fc486-6926-4ebe-9da3-46cc3028e0de tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:10.204489 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-343fc486-6926-4ebe-9da3-46cc3028e0de tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8cd3b906-abcb-4669-9d1b-0dd3133ec23e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045235 Aug 06 14:40:10.205027 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 532/1015] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Aug 6 14:40:10 2022] GET /compute/v2.1/servers/8cd3b906-abcb-4669-9d1b-0dd3133ec23e/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 14:40:10.264925 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-5edb9d01-267e-4cd5-aed6-075326ce8713 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:40:10.265397 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-5edb9d01-267e-4cd5-aed6-075326ce8713 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8cd3b906-abcb-4669-9d1b-0dd3133ec23e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:40:10.271240 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5edb9d01-267e-4cd5-aed6-075326ce8713 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:10.271712 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5edb9d01-267e-4cd5-aed6-075326ce8713 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:10.272140 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5edb9d01-267e-4cd5-aed6-075326ce8713 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:10.272819 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5edb9d01-267e-4cd5-aed6-075326ce8713 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:10.273264 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5edb9d01-267e-4cd5-aed6-075326ce8713 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:10.273680 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5edb9d01-267e-4cd5-aed6-075326ce8713 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:10.298433 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-5edb9d01-267e-4cd5-aed6-075326ce8713 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8cd3b906-abcb-4669-9d1b-0dd3133ec23e] Going to try to terminate instance {{(pid=117838) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 14:40:10.372275 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-5edb9d01-267e-4cd5-aed6-075326ce8713 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "DELETE /compute/v2.1/servers/8cd3b906-abcb-4669-9d1b-0dd3133ec23e" status: 204 len: 0 microversion: 2.1 time: 0.110831 Aug 06 14:40:10.373029 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 484/1016] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Aug 6 14:40:10 2022] DELETE /compute/v2.1/servers/8cd3b906-abcb-4669-9d1b-0dd3133ec23e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 14:40:10.381562 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-61279a0b-c9b5-45ec-bc2a-df779da81c71 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:40:10.382176 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-61279a0b-c9b5-45ec-bc2a-df779da81c71 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8cd3b906-abcb-4669-9d1b-0dd3133ec23e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:40:10.388130 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-61279a0b-c9b5-45ec-bc2a-df779da81c71 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:10.388606 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-61279a0b-c9b5-45ec-bc2a-df779da81c71 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:10.389039 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-61279a0b-c9b5-45ec-bc2a-df779da81c71 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:10.390223 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-61279a0b-c9b5-45ec-bc2a-df779da81c71 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:10.390677 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-61279a0b-c9b5-45ec-bc2a-df779da81c71 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:10.391157 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-61279a0b-c9b5-45ec-bc2a-df779da81c71 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:10.520256 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-61279a0b-c9b5-45ec-bc2a-df779da81c71 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:40:10.527757 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-61279a0b-c9b5-45ec-bc2a-df779da81c71 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8cd3b906-abcb-4669-9d1b-0dd3133ec23e" status: 200 len: 1674 microversion: 2.1 time: 0.150110 Aug 06 14:40:10.528337 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 533/1017] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:40:10 2022] GET /compute/v2.1/servers/8cd3b906-abcb-4669-9d1b-0dd3133ec23e => generated 1674 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:40:11.550197 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-a7c0d11c-4554-4ea2-8a40-944f8632d53f tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:40:11.550939 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-a7c0d11c-4554-4ea2-8a40-944f8632d53f tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8cd3b906-abcb-4669-9d1b-0dd3133ec23e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:40:11.557308 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a7c0d11c-4554-4ea2-8a40-944f8632d53f tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:11.558038 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a7c0d11c-4554-4ea2-8a40-944f8632d53f tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:11.558465 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a7c0d11c-4554-4ea2-8a40-944f8632d53f tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:11.559166 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a7c0d11c-4554-4ea2-8a40-944f8632d53f tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:11.559614 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a7c0d11c-4554-4ea2-8a40-944f8632d53f tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:11.560030 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a7c0d11c-4554-4ea2-8a40-944f8632d53f tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:11.692506 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-a7c0d11c-4554-4ea2-8a40-944f8632d53f tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:40:11.699978 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-a7c0d11c-4554-4ea2-8a40-944f8632d53f tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8cd3b906-abcb-4669-9d1b-0dd3133ec23e" status: 200 len: 1674 microversion: 2.1 time: 0.154073 Aug 06 14:40:11.700530 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 485/1018] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:40:11 2022] GET /compute/v2.1/servers/8cd3b906-abcb-4669-9d1b-0dd3133ec23e => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:40:12.722288 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-8386d315-4b72-4e5f-a528-319935623f82 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:40:12.722921 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-8386d315-4b72-4e5f-a528-319935623f82 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8cd3b906-abcb-4669-9d1b-0dd3133ec23e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:40:12.729289 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8386d315-4b72-4e5f-a528-319935623f82 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:12.729775 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8386d315-4b72-4e5f-a528-319935623f82 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:12.730211 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8386d315-4b72-4e5f-a528-319935623f82 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:12.730932 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8386d315-4b72-4e5f-a528-319935623f82 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:12.731392 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8386d315-4b72-4e5f-a528-319935623f82 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:12.731821 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8386d315-4b72-4e5f-a528-319935623f82 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:12.943359 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-8386d315-4b72-4e5f-a528-319935623f82 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:40:12.950850 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-8386d315-4b72-4e5f-a528-319935623f82 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8cd3b906-abcb-4669-9d1b-0dd3133ec23e" status: 200 len: 1674 microversion: 2.1 time: 0.233151 Aug 06 14:40:12.951506 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 534/1019] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:40:12 2022] GET /compute/v2.1/servers/8cd3b906-abcb-4669-9d1b-0dd3133ec23e => generated 1674 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:40:13.560139 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [req-8e09ea81-cc07-4a21-ae44-9ceaddaea761 req-17d2bb39-0378-49f5-8d2c-0c94206322ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cd3b906-abcb-4669-9d1b-0dd3133ec23e", "name": "network-vif-deleted", "tag": "1dfff01d-0a08-4442-88d9-0edaf57e0f1a"}]} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:40:13.573413 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-8e09ea81-cc07-4a21-ae44-9ceaddaea761 req-17d2bb39-0378-49f5-8d2c-0c94206322ee service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:13.573900 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-8e09ea81-cc07-4a21-ae44-9ceaddaea761 req-17d2bb39-0378-49f5-8d2c-0c94206322ee service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:13.574333 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-8e09ea81-cc07-4a21-ae44-9ceaddaea761 req-17d2bb39-0378-49f5-8d2c-0c94206322ee service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:13.590063 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.compute.server_external_events [req-8e09ea81-cc07-4a21-ae44-9ceaddaea761 req-17d2bb39-0378-49f5-8d2c-0c94206322ee service nova] Creating event network-vif-deleted:1dfff01d-0a08-4442-88d9-0edaf57e0f1a for instance 8cd3b906-abcb-4669-9d1b-0dd3133ec23e on hv-cinder-85199 Aug 06 14:40:13.597449 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [req-8e09ea81-cc07-4a21-ae44-9ceaddaea761 req-17d2bb39-0378-49f5-8d2c-0c94206322ee service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107865 Aug 06 14:40:13.598752 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 486/1020] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:40:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:40:13.973134 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-911fcddb-7f1d-4121-a4c0-1eb1b86399cf tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:40:13.973977 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-911fcddb-7f1d-4121-a4c0-1eb1b86399cf tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8cd3b906-abcb-4669-9d1b-0dd3133ec23e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:40:13.980214 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-911fcddb-7f1d-4121-a4c0-1eb1b86399cf tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:13.980788 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-911fcddb-7f1d-4121-a4c0-1eb1b86399cf tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:13.981479 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-911fcddb-7f1d-4121-a4c0-1eb1b86399cf tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:13.982252 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-911fcddb-7f1d-4121-a4c0-1eb1b86399cf tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:13.982776 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-911fcddb-7f1d-4121-a4c0-1eb1b86399cf tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:13.984025 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-911fcddb-7f1d-4121-a4c0-1eb1b86399cf tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:14.015296 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-911fcddb-7f1d-4121-a4c0-1eb1b86399cf tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:14.015787 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-911fcddb-7f1d-4121-a4c0-1eb1b86399cf tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:14.016226 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-911fcddb-7f1d-4121-a4c0-1eb1b86399cf tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:14.016674 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.objects.instance [None req-911fcddb-7f1d-4121-a4c0-1eb1b86399cf tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lazy-loading 'fault' on Instance uuid 8cd3b906-abcb-4669-9d1b-0dd3133ec23e {{(pid=117837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 14:40:14.062453 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-911fcddb-7f1d-4121-a4c0-1eb1b86399cf tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3e987dfd35f4a5da36d5034970fcf59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c17d83661330425d8c75a2562df8e16e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:40:14.071917 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-911fcddb-7f1d-4121-a4c0-1eb1b86399cf tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8cd3b906-abcb-4669-9d1b-0dd3133ec23e" status: 200 len: 1328 microversion: 2.1 time: 0.102255 Aug 06 14:40:14.073014 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 535/1021] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:40:13 2022] GET /compute/v2.1/servers/8cd3b906-abcb-4669-9d1b-0dd3133ec23e => generated 1328 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:40:15.094769 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-7ba340e4-c366-49f3-bfe3-2a0e495766fc tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:40:15.095525 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-7ba340e4-c366-49f3-bfe3-2a0e495766fc tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8cd3b906-abcb-4669-9d1b-0dd3133ec23e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:40:15.102234 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7ba340e4-c366-49f3-bfe3-2a0e495766fc tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:15.102653 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7ba340e4-c366-49f3-bfe3-2a0e495766fc tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:15.103108 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7ba340e4-c366-49f3-bfe3-2a0e495766fc tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:15.103790 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7ba340e4-c366-49f3-bfe3-2a0e495766fc tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:15.104238 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7ba340e4-c366-49f3-bfe3-2a0e495766fc tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:15.104656 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7ba340e4-c366-49f3-bfe3-2a0e495766fc tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:15.117905 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.wsgi [None req-7ba340e4-c366-49f3-bfe3-2a0e495766fc tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] HTTP exception thrown: Instance 8cd3b906-abcb-4669-9d1b-0dd3133ec23e could not be found. Aug 06 14:40:15.119557 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-7ba340e4-c366-49f3-bfe3-2a0e495766fc tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Request method failure captured: Aug 06 14:40:15.119557 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: request: GET /compute/v2.1/servers/8cd3b906-abcb-4669-9d1b-0dd3133ec23e HTTP/1.1 Aug 06 14:40:15.119557 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Accept: application/json Aug 06 14:40:15.119557 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Accept-Encoding: identity Aug 06 14:40:15.119557 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Connection: close Aug 06 14:40:15.119557 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Content-Length: 0 Aug 06 14:40:15.119557 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Content-Type: application/json Aug 06 14:40:15.119557 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Host: 10.222.0.17 Aug 06 14:40:15.119557 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Openstack-System-Scope: None Aug 06 14:40:15.119557 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: User-Agent: python-urllib3/1.26.11 Aug 06 14:40:15.119557 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Auth-Token: gAAAAABi7nr59NgGbxivLiK18VWB0XiiDtxp0PLtFFiLiXSXaRHTpXpwyOZtsmZzTOVR5AS_8JU0kJ8QI2ROJLr2EyNbK_gorp9MlUB3uEgEGNAnkHJm1dOAHnr-UKSbZxoNr-_Dlz05vNvs4b3T6VfhWxUqU7iFjLljGv9q-XXPb5O8Lad9rDA Aug 06 14:40:15.119557 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Domain-Id: None Aug 06 14:40:15.119557 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Domain-Name: None Aug 06 14:40:15.119557 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Identity-Status: Confirmed Aug 06 14:40:15.119557 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Is-Admin-Project: True Aug 06 14:40:15.119557 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Domain-Id: default Aug 06 14:40:15.119557 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Domain-Name: Default Aug 06 14:40:15.119557 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Id: c17d83661330425d8c75a2562df8e16e Aug 06 14:40:15.119557 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Name: tempest-AttachVolumeTestJSON-1474795993 Aug 06 14:40:15.119557 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Role: member,reader Aug 06 14:40:15.119557 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Roles: member,reader Aug 06 14:40:15.121190 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c17d83661330425d8c75a2562df8e16e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c17d83661330425d8c75a2562df8e16e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c17d83661330425d8c75a2562df8e16e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c17d83661330425d8c75a2562df8e16e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 06 14:40:15.121190 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Tenant: tempest-AttachVolumeTestJSON-1474795993 Aug 06 14:40:15.121190 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Tenant-Id: c17d83661330425d8c75a2562df8e16e Aug 06 14:40:15.121190 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1474795993 Aug 06 14:40:15.121190 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User: tempest-AttachVolumeTestJSON-1474795993-project Aug 06 14:40:15.121190 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Domain-Id: default Aug 06 14:40:15.121190 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Domain-Name: Default Aug 06 14:40:15.121190 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Id: a3e987dfd35f4a5da36d5034970fcf59 Aug 06 14:40:15.121190 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Name: tempest-AttachVolumeTestJSON-1474795993-project Aug 06 14:40:15.121190 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: method: > Aug 06 14:40:15.121190 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: exception: Instance 8cd3b906-abcb-4669-9d1b-0dd3133ec23e could not be found. Aug 06 14:40:15.121190 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: action_args: {'id': '8cd3b906-abcb-4669-9d1b-0dd3133ec23e'} Aug 06 14:40:15.122114 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 14:40:15.122114 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:40:15.122114 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 14:40:15.122114 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 14:40:15.122114 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 14:40:15.122114 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 14:40:15.122114 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 14:40:15.122114 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 14:40:15.122114 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 14:40:15.122114 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 14:40:15.122114 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cd3b906-abcb-4669-9d1b-0dd3133ec23e could not be found. Aug 06 14:40:15.122114 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:40:15.122114 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:40:15.122114 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:40:15.122114 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:40:15.122114 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:40:15.122114 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:40:15.122114 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 14:40:15.122114 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 14:40:15.122114 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 14:40:15.123766 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 14:40:15.123766 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 14:40:15.123766 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 14:40:15.123766 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 14:40:15.123766 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 14:40:15.123766 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 14:40:15.123766 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 14:40:15.123766 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cd3b906-abcb-4669-9d1b-0dd3133ec23e could not be found. Aug 06 14:40:15.123766 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:40:15.123766 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:40:15.123766 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:40:15.123766 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:40:15.123766 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:40:15.123766 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:40:15.123766 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 14:40:15.123766 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 14:40:15.123766 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cd3b906-abcb-4669-9d1b-0dd3133ec23e could not be found. Aug 06 14:40:15.123766 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:40:15.125306 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-7ba340e4-c366-49f3-bfe3-2a0e495766fc tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Returning 404 to user: Instance 8cd3b906-abcb-4669-9d1b-0dd3133ec23e could not be found. {{(pid=117838) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 14:40:15.125306 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-7ba340e4-c366-49f3-bfe3-2a0e495766fc tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8cd3b906-abcb-4669-9d1b-0dd3133ec23e" status: 404 len: 111 microversion: 2.1 time: 0.031057 Aug 06 14:40:15.125306 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 487/1022] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:40:15 2022] GET /compute/v2.1/servers/8cd3b906-abcb-4669-9d1b-0dd3133ec23e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 14:40:15.129693 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-d3ce8c5f-cc46-460a-a9ea-c09f11a8e649 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '.version_select at 0x7fbab5c76670>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:40:15.150968 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-d3ce8c5f-cc46-460a-a9ea-c09f11a8e649 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1428514355" status: 202 len: 0 microversion: 2.1 time: 0.025032 Aug 06 14:40:15.151509 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 536/1023] 10.222.0.17 () {58 vars in 1221 bytes} [Sat Aug 6 14:40:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1428514355 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 06 14:40:18.026589 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-36960da0-3830-4e6e-b519-5fb4e77e2a20 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:40:18.027119 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-36960da0-3830-4e6e-b519-5fb4e77e2a20 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8cd3b906-abcb-4669-9d1b-0dd3133ec23e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:40:18.033432 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-36960da0-3830-4e6e-b519-5fb4e77e2a20 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:18.033910 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-36960da0-3830-4e6e-b519-5fb4e77e2a20 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:18.034337 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-36960da0-3830-4e6e-b519-5fb4e77e2a20 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:18.035060 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-36960da0-3830-4e6e-b519-5fb4e77e2a20 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:18.035512 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-36960da0-3830-4e6e-b519-5fb4e77e2a20 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:18.035929 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-36960da0-3830-4e6e-b519-5fb4e77e2a20 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:18.039953 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:40:18.050583 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.wsgi [None req-36960da0-3830-4e6e-b519-5fb4e77e2a20 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] HTTP exception thrown: Instance 8cd3b906-abcb-4669-9d1b-0dd3133ec23e could not be found. Aug 06 14:40:18.052305 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-36960da0-3830-4e6e-b519-5fb4e77e2a20 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Request method failure captured: Aug 06 14:40:18.052305 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: request: DELETE /compute/v2.1/servers/8cd3b906-abcb-4669-9d1b-0dd3133ec23e HTTP/1.1 Aug 06 14:40:18.052305 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Accept: application/json Aug 06 14:40:18.052305 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Accept-Encoding: identity Aug 06 14:40:18.052305 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Connection: close Aug 06 14:40:18.052305 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Content-Length: 0 Aug 06 14:40:18.052305 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Content-Type: application/json Aug 06 14:40:18.052305 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Host: 10.222.0.17 Aug 06 14:40:18.052305 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Openstack-System-Scope: None Aug 06 14:40:18.052305 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: User-Agent: python-urllib3/1.26.11 Aug 06 14:40:18.052305 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Auth-Token: gAAAAABi7nr59NgGbxivLiK18VWB0XiiDtxp0PLtFFiLiXSXaRHTpXpwyOZtsmZzTOVR5AS_8JU0kJ8QI2ROJLr2EyNbK_gorp9MlUB3uEgEGNAnkHJm1dOAHnr-UKSbZxoNr-_Dlz05vNvs4b3T6VfhWxUqU7iFjLljGv9q-XXPb5O8Lad9rDA Aug 06 14:40:18.052305 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Domain-Id: None Aug 06 14:40:18.052305 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Domain-Name: None Aug 06 14:40:18.052305 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Identity-Status: Confirmed Aug 06 14:40:18.052305 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Is-Admin-Project: True Aug 06 14:40:18.052305 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Domain-Id: default Aug 06 14:40:18.052305 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Domain-Name: Default Aug 06 14:40:18.052305 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Id: c17d83661330425d8c75a2562df8e16e Aug 06 14:40:18.052305 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Name: tempest-AttachVolumeTestJSON-1474795993 Aug 06 14:40:18.052305 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Role: member,reader Aug 06 14:40:18.052305 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Roles: member,reader Aug 06 14:40:18.053898 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c17d83661330425d8c75a2562df8e16e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c17d83661330425d8c75a2562df8e16e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c17d83661330425d8c75a2562df8e16e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c17d83661330425d8c75a2562df8e16e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 06 14:40:18.053898 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Tenant: tempest-AttachVolumeTestJSON-1474795993 Aug 06 14:40:18.053898 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Tenant-Id: c17d83661330425d8c75a2562df8e16e Aug 06 14:40:18.053898 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1474795993 Aug 06 14:40:18.053898 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User: tempest-AttachVolumeTestJSON-1474795993-project Aug 06 14:40:18.053898 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Domain-Id: default Aug 06 14:40:18.053898 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Domain-Name: Default Aug 06 14:40:18.053898 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Id: a3e987dfd35f4a5da36d5034970fcf59 Aug 06 14:40:18.053898 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Name: tempest-AttachVolumeTestJSON-1474795993-project Aug 06 14:40:18.053898 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: method: > Aug 06 14:40:18.053898 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: exception: Instance 8cd3b906-abcb-4669-9d1b-0dd3133ec23e could not be found. Aug 06 14:40:18.053898 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: action_args: {'id': '8cd3b906-abcb-4669-9d1b-0dd3133ec23e'} Aug 06 14:40:18.054784 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 14:40:18.054784 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:40:18.054784 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 14:40:18.054784 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 14:40:18.054784 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 14:40:18.054784 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 14:40:18.054784 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 14:40:18.054784 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 14:40:18.054784 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 14:40:18.054784 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 14:40:18.054784 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cd3b906-abcb-4669-9d1b-0dd3133ec23e could not be found. Aug 06 14:40:18.054784 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:40:18.054784 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:40:18.054784 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:40:18.054784 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:40:18.054784 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:40:18.054784 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:40:18.054784 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 14:40:18.054784 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 14:40:18.054784 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 14:40:18.056008 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 14:40:18.056008 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 14:40:18.056008 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 14:40:18.056008 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 14:40:18.056008 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 14:40:18.056008 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 14:40:18.056008 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 14:40:18.056008 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 14:40:18.056008 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 14:40:18.056008 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cd3b906-abcb-4669-9d1b-0dd3133ec23e could not be found. Aug 06 14:40:18.056008 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:40:18.056008 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:40:18.056008 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:40:18.056008 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:40:18.056008 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:40:18.056008 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:40:18.056008 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 14:40:18.056008 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 14:40:18.056008 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cd3b906-abcb-4669-9d1b-0dd3133ec23e could not be found. Aug 06 14:40:18.056008 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:40:18.057183 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-36960da0-3830-4e6e-b519-5fb4e77e2a20 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Returning 404 to user: Instance 8cd3b906-abcb-4669-9d1b-0dd3133ec23e could not be found. {{(pid=117838) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 14:40:18.057183 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-36960da0-3830-4e6e-b519-5fb4e77e2a20 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "DELETE /compute/v2.1/servers/8cd3b906-abcb-4669-9d1b-0dd3133ec23e" status: 404 len: 111 microversion: 2.1 time: 0.030919 Aug 06 14:40:18.057183 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 488/1024] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Aug 6 14:40:18 2022] DELETE /compute/v2.1/servers/8cd3b906-abcb-4669-9d1b-0dd3133ec23e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 14:40:18.063627 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-7a85303e-5fba-4289-8e9d-b1cffc8c8b45 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:40:18.064250 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-7a85303e-5fba-4289-8e9d-b1cffc8c8b45 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8cd3b906-abcb-4669-9d1b-0dd3133ec23e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:40:18.070666 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7a85303e-5fba-4289-8e9d-b1cffc8c8b45 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:18.071241 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7a85303e-5fba-4289-8e9d-b1cffc8c8b45 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:18.071683 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7a85303e-5fba-4289-8e9d-b1cffc8c8b45 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:18.072369 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7a85303e-5fba-4289-8e9d-b1cffc8c8b45 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:18.072823 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7a85303e-5fba-4289-8e9d-b1cffc8c8b45 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:18.073248 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7a85303e-5fba-4289-8e9d-b1cffc8c8b45 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:18.086749 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.wsgi [None req-7a85303e-5fba-4289-8e9d-b1cffc8c8b45 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] HTTP exception thrown: Instance 8cd3b906-abcb-4669-9d1b-0dd3133ec23e could not be found. Aug 06 14:40:18.088464 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-7a85303e-5fba-4289-8e9d-b1cffc8c8b45 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Request method failure captured: Aug 06 14:40:18.088464 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: request: GET /compute/v2.1/servers/8cd3b906-abcb-4669-9d1b-0dd3133ec23e HTTP/1.1 Aug 06 14:40:18.088464 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Accept: application/json Aug 06 14:40:18.088464 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Accept-Encoding: identity Aug 06 14:40:18.088464 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Connection: close Aug 06 14:40:18.088464 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Content-Length: 0 Aug 06 14:40:18.088464 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Content-Type: application/json Aug 06 14:40:18.088464 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Host: 10.222.0.17 Aug 06 14:40:18.088464 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Openstack-System-Scope: None Aug 06 14:40:18.088464 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: User-Agent: python-urllib3/1.26.11 Aug 06 14:40:18.088464 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Auth-Token: gAAAAABi7nr59NgGbxivLiK18VWB0XiiDtxp0PLtFFiLiXSXaRHTpXpwyOZtsmZzTOVR5AS_8JU0kJ8QI2ROJLr2EyNbK_gorp9MlUB3uEgEGNAnkHJm1dOAHnr-UKSbZxoNr-_Dlz05vNvs4b3T6VfhWxUqU7iFjLljGv9q-XXPb5O8Lad9rDA Aug 06 14:40:18.088464 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Domain-Id: None Aug 06 14:40:18.088464 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Domain-Name: None Aug 06 14:40:18.088464 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Identity-Status: Confirmed Aug 06 14:40:18.088464 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Is-Admin-Project: True Aug 06 14:40:18.088464 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Domain-Id: default Aug 06 14:40:18.088464 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Domain-Name: Default Aug 06 14:40:18.088464 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Id: c17d83661330425d8c75a2562df8e16e Aug 06 14:40:18.088464 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Name: tempest-AttachVolumeTestJSON-1474795993 Aug 06 14:40:18.088464 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Role: member,reader Aug 06 14:40:18.088464 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Roles: member,reader Aug 06 14:40:18.089980 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c17d83661330425d8c75a2562df8e16e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c17d83661330425d8c75a2562df8e16e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c17d83661330425d8c75a2562df8e16e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c17d83661330425d8c75a2562df8e16e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 06 14:40:18.089980 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant: tempest-AttachVolumeTestJSON-1474795993 Aug 06 14:40:18.089980 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant-Id: c17d83661330425d8c75a2562df8e16e Aug 06 14:40:18.089980 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1474795993 Aug 06 14:40:18.089980 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User: tempest-AttachVolumeTestJSON-1474795993-project Aug 06 14:40:18.089980 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Domain-Id: default Aug 06 14:40:18.089980 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Domain-Name: Default Aug 06 14:40:18.089980 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Id: a3e987dfd35f4a5da36d5034970fcf59 Aug 06 14:40:18.089980 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Name: tempest-AttachVolumeTestJSON-1474795993-project Aug 06 14:40:18.089980 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: method: > Aug 06 14:40:18.089980 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: exception: Instance 8cd3b906-abcb-4669-9d1b-0dd3133ec23e could not be found. Aug 06 14:40:18.089980 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: action_args: {'id': '8cd3b906-abcb-4669-9d1b-0dd3133ec23e'} Aug 06 14:40:18.090787 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 14:40:18.090787 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:40:18.090787 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 14:40:18.090787 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 14:40:18.090787 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 14:40:18.090787 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 14:40:18.090787 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 14:40:18.090787 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 14:40:18.090787 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 14:40:18.090787 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 14:40:18.090787 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cd3b906-abcb-4669-9d1b-0dd3133ec23e could not be found. Aug 06 14:40:18.090787 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:40:18.090787 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:40:18.090787 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:40:18.090787 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:40:18.090787 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:40:18.090787 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:40:18.090787 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 14:40:18.090787 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 14:40:18.090787 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 14:40:18.093059 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 14:40:18.093059 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 14:40:18.093059 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 14:40:18.093059 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 14:40:18.093059 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 14:40:18.093059 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 14:40:18.093059 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 14:40:18.093059 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cd3b906-abcb-4669-9d1b-0dd3133ec23e could not be found. Aug 06 14:40:18.093059 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:40:18.093059 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:40:18.093059 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:40:18.093059 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:40:18.093059 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:40:18.093059 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:40:18.093059 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 14:40:18.093059 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 14:40:18.093059 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cd3b906-abcb-4669-9d1b-0dd3133ec23e could not be found. Aug 06 14:40:18.093059 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:40:18.094593 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-7a85303e-5fba-4289-8e9d-b1cffc8c8b45 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Returning 404 to user: Instance 8cd3b906-abcb-4669-9d1b-0dd3133ec23e could not be found. {{(pid=117837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 14:40:18.094593 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-7a85303e-5fba-4289-8e9d-b1cffc8c8b45 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8cd3b906-abcb-4669-9d1b-0dd3133ec23e" status: 404 len: 111 microversion: 2.1 time: 0.031414 Aug 06 14:40:18.094593 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 537/1025] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:40:18 2022] GET /compute/v2.1/servers/8cd3b906-abcb-4669-9d1b-0dd3133ec23e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 14:40:19.232027 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-4b986104-83ab-497b-af2c-9ec01ed4fb42 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:40:19.232512 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-4b986104-83ab-497b-af2c-9ec01ed4fb42 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:40:19.240533 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4b986104-83ab-497b-af2c-9ec01ed4fb42 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:19.241012 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4b986104-83ab-497b-af2c-9ec01ed4fb42 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:19.241444 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4b986104-83ab-497b-af2c-9ec01ed4fb42 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:19.242130 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4b986104-83ab-497b-af2c-9ec01ed4fb42 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:19.242581 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4b986104-83ab-497b-af2c-9ec01ed4fb42 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:19.243038 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4b986104-83ab-497b-af2c-9ec01ed4fb42 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:19.256562 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.wsgi [None req-4b986104-83ab-497b-af2c-9ec01ed4fb42 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] HTTP exception thrown: Instance 8b9f7623-548a-4f92-8f60-9d7ee92e0fac could not be found. Aug 06 14:40:19.258085 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-4b986104-83ab-497b-af2c-9ec01ed4fb42 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Request method failure captured: Aug 06 14:40:19.258085 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: request: DELETE /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac HTTP/1.1 Aug 06 14:40:19.258085 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Accept: application/json Aug 06 14:40:19.258085 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Accept-Encoding: identity Aug 06 14:40:19.258085 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Connection: close Aug 06 14:40:19.258085 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Content-Length: 0 Aug 06 14:40:19.258085 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Content-Type: application/json Aug 06 14:40:19.258085 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Host: 10.222.0.17 Aug 06 14:40:19.258085 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Openstack-System-Scope: None Aug 06 14:40:19.258085 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: User-Agent: python-urllib3/1.26.11 Aug 06 14:40:19.258085 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Auth-Token: gAAAAABi7nr59NgGbxivLiK18VWB0XiiDtxp0PLtFFiLiXSXaRHTpXpwyOZtsmZzTOVR5AS_8JU0kJ8QI2ROJLr2EyNbK_gorp9MlUB3uEgEGNAnkHJm1dOAHnr-UKSbZxoNr-_Dlz05vNvs4b3T6VfhWxUqU7iFjLljGv9q-XXPb5O8Lad9rDA Aug 06 14:40:19.258085 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Domain-Id: None Aug 06 14:40:19.258085 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Domain-Name: None Aug 06 14:40:19.258085 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Identity-Status: Confirmed Aug 06 14:40:19.258085 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Is-Admin-Project: True Aug 06 14:40:19.258085 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Domain-Id: default Aug 06 14:40:19.258085 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Domain-Name: Default Aug 06 14:40:19.258085 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Id: c17d83661330425d8c75a2562df8e16e Aug 06 14:40:19.258085 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Name: tempest-AttachVolumeTestJSON-1474795993 Aug 06 14:40:19.258085 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Role: member,reader Aug 06 14:40:19.258085 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Roles: member,reader Aug 06 14:40:19.259650 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c17d83661330425d8c75a2562df8e16e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c17d83661330425d8c75a2562df8e16e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c17d83661330425d8c75a2562df8e16e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c17d83661330425d8c75a2562df8e16e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 06 14:40:19.259650 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Tenant: tempest-AttachVolumeTestJSON-1474795993 Aug 06 14:40:19.259650 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Tenant-Id: c17d83661330425d8c75a2562df8e16e Aug 06 14:40:19.259650 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1474795993 Aug 06 14:40:19.259650 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User: tempest-AttachVolumeTestJSON-1474795993-project Aug 06 14:40:19.259650 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Domain-Id: default Aug 06 14:40:19.259650 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Domain-Name: Default Aug 06 14:40:19.259650 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Id: a3e987dfd35f4a5da36d5034970fcf59 Aug 06 14:40:19.259650 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Name: tempest-AttachVolumeTestJSON-1474795993-project Aug 06 14:40:19.259650 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: method: > Aug 06 14:40:19.259650 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: exception: Instance 8b9f7623-548a-4f92-8f60-9d7ee92e0fac could not be found. Aug 06 14:40:19.259650 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: action_args: {'id': '8b9f7623-548a-4f92-8f60-9d7ee92e0fac'} Aug 06 14:40:19.260549 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 14:40:19.260549 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:40:19.260549 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 14:40:19.260549 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 14:40:19.260549 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 14:40:19.260549 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 14:40:19.260549 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 14:40:19.260549 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 14:40:19.260549 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 14:40:19.260549 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 14:40:19.260549 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b9f7623-548a-4f92-8f60-9d7ee92e0fac could not be found. Aug 06 14:40:19.260549 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:40:19.260549 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:40:19.260549 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:40:19.260549 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:40:19.260549 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:40:19.260549 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:40:19.260549 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 14:40:19.260549 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 14:40:19.260549 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 14:40:19.261742 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 14:40:19.261742 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 14:40:19.261742 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 14:40:19.261742 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 14:40:19.261742 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 14:40:19.261742 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 14:40:19.261742 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 14:40:19.261742 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 14:40:19.261742 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 14:40:19.261742 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b9f7623-548a-4f92-8f60-9d7ee92e0fac could not be found. Aug 06 14:40:19.261742 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:40:19.261742 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:40:19.261742 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:40:19.261742 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:40:19.261742 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:40:19.261742 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:40:19.261742 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 14:40:19.261742 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 14:40:19.261742 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b9f7623-548a-4f92-8f60-9d7ee92e0fac could not be found. Aug 06 14:40:19.261742 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:40:19.263710 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-4b986104-83ab-497b-af2c-9ec01ed4fb42 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Returning 404 to user: Instance 8b9f7623-548a-4f92-8f60-9d7ee92e0fac could not be found. {{(pid=117838) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 14:40:19.263710 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-4b986104-83ab-497b-af2c-9ec01ed4fb42 tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "DELETE /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 404 len: 111 microversion: 2.1 time: 0.031646 Aug 06 14:40:19.263710 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 489/1026] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Aug 6 14:40:19 2022] DELETE /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 14:40:19.267788 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-ca4cd852-6734-469a-96fc-d65a9910489e tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:40:19.268396 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-ca4cd852-6734-469a-96fc-d65a9910489e tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] [instance: 8b9f7623-548a-4f92-8f60-9d7ee92e0fac] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:40:19.274733 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ca4cd852-6734-469a-96fc-d65a9910489e tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:19.275239 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ca4cd852-6734-469a-96fc-d65a9910489e tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:19.275672 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ca4cd852-6734-469a-96fc-d65a9910489e tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:19.276356 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ca4cd852-6734-469a-96fc-d65a9910489e tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:19.276808 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ca4cd852-6734-469a-96fc-d65a9910489e tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:19.277227 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ca4cd852-6734-469a-96fc-d65a9910489e tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:19.290482 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.wsgi [None req-ca4cd852-6734-469a-96fc-d65a9910489e tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] HTTP exception thrown: Instance 8b9f7623-548a-4f92-8f60-9d7ee92e0fac could not be found. Aug 06 14:40:19.292007 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-ca4cd852-6734-469a-96fc-d65a9910489e tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Request method failure captured: Aug 06 14:40:19.292007 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: request: GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac HTTP/1.1 Aug 06 14:40:19.292007 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Accept: application/json Aug 06 14:40:19.292007 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Accept-Encoding: identity Aug 06 14:40:19.292007 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Connection: close Aug 06 14:40:19.292007 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Content-Length: 0 Aug 06 14:40:19.292007 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Content-Type: application/json Aug 06 14:40:19.292007 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Host: 10.222.0.17 Aug 06 14:40:19.292007 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Openstack-System-Scope: None Aug 06 14:40:19.292007 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: User-Agent: python-urllib3/1.26.11 Aug 06 14:40:19.292007 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Auth-Token: gAAAAABi7nr59NgGbxivLiK18VWB0XiiDtxp0PLtFFiLiXSXaRHTpXpwyOZtsmZzTOVR5AS_8JU0kJ8QI2ROJLr2EyNbK_gorp9MlUB3uEgEGNAnkHJm1dOAHnr-UKSbZxoNr-_Dlz05vNvs4b3T6VfhWxUqU7iFjLljGv9q-XXPb5O8Lad9rDA Aug 06 14:40:19.292007 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Domain-Id: None Aug 06 14:40:19.292007 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Domain-Name: None Aug 06 14:40:19.292007 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Identity-Status: Confirmed Aug 06 14:40:19.292007 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Is-Admin-Project: True Aug 06 14:40:19.292007 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Domain-Id: default Aug 06 14:40:19.292007 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Domain-Name: Default Aug 06 14:40:19.292007 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Id: c17d83661330425d8c75a2562df8e16e Aug 06 14:40:19.292007 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Name: tempest-AttachVolumeTestJSON-1474795993 Aug 06 14:40:19.292007 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Role: member,reader Aug 06 14:40:19.292007 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Roles: member,reader Aug 06 14:40:19.293511 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c17d83661330425d8c75a2562df8e16e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/c17d83661330425d8c75a2562df8e16e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_c17d83661330425d8c75a2562df8e16e", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/c17d83661330425d8c75a2562df8e16e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 06 14:40:19.293511 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant: tempest-AttachVolumeTestJSON-1474795993 Aug 06 14:40:19.293511 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant-Id: c17d83661330425d8c75a2562df8e16e Aug 06 14:40:19.293511 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1474795993 Aug 06 14:40:19.293511 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User: tempest-AttachVolumeTestJSON-1474795993-project Aug 06 14:40:19.293511 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Domain-Id: default Aug 06 14:40:19.293511 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Domain-Name: Default Aug 06 14:40:19.293511 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Id: a3e987dfd35f4a5da36d5034970fcf59 Aug 06 14:40:19.293511 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Name: tempest-AttachVolumeTestJSON-1474795993-project Aug 06 14:40:19.293511 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: method: > Aug 06 14:40:19.293511 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: exception: Instance 8b9f7623-548a-4f92-8f60-9d7ee92e0fac could not be found. Aug 06 14:40:19.293511 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: action_args: {'id': '8b9f7623-548a-4f92-8f60-9d7ee92e0fac'} Aug 06 14:40:19.294455 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 14:40:19.294455 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:40:19.294455 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 14:40:19.294455 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 14:40:19.294455 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 14:40:19.294455 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 14:40:19.294455 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 14:40:19.294455 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 14:40:19.294455 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 14:40:19.294455 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 14:40:19.294455 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b9f7623-548a-4f92-8f60-9d7ee92e0fac could not be found. Aug 06 14:40:19.294455 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:40:19.294455 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:40:19.294455 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:40:19.294455 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:40:19.294455 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:40:19.294455 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:40:19.294455 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 14:40:19.294455 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 14:40:19.294455 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 14:40:19.296555 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 14:40:19.296555 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 14:40:19.296555 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 14:40:19.296555 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 14:40:19.296555 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 14:40:19.296555 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 14:40:19.296555 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 14:40:19.296555 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b9f7623-548a-4f92-8f60-9d7ee92e0fac could not be found. Aug 06 14:40:19.296555 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:40:19.296555 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:40:19.296555 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:40:19.296555 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:40:19.296555 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:40:19.296555 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:40:19.296555 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 14:40:19.296555 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 14:40:19.296555 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b9f7623-548a-4f92-8f60-9d7ee92e0fac could not be found. Aug 06 14:40:19.296555 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:40:19.297809 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-ca4cd852-6734-469a-96fc-d65a9910489e tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] Returning 404 to user: Instance 8b9f7623-548a-4f92-8f60-9d7ee92e0fac could not be found. {{(pid=117837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 14:40:19.297809 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-ca4cd852-6734-469a-96fc-d65a9910489e tempest-AttachVolumeTestJSON-1474795993 tempest-AttachVolumeTestJSON-1474795993-project] 10.222.0.17 "GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac" status: 404 len: 111 microversion: 2.1 time: 0.029368 Aug 06 14:40:19.297809 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 538/1027] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:40:19 2022] GET /compute/v2.1/servers/8b9f7623-548a-4f92-8f60-9d7ee92e0fac => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 14:40:30.020735 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-714d34c2-ada2-4907-a4b9-ae4e223b25e2 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:40:30.021240 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-714d34c2-ada2-4907-a4b9-ae4e223b25e2 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 4ae413eb-83c0-48ab-818c-f75d9727d345] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:40:30.023733 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:40:30.024410 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_cell1:SELECT=3 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:40:30.030923 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-714d34c2-ada2-4907-a4b9-ae4e223b25e2 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:30.031407 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-714d34c2-ada2-4907-a4b9-ae4e223b25e2 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:30.031842 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-714d34c2-ada2-4907-a4b9-ae4e223b25e2 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:30.032530 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-714d34c2-ada2-4907-a4b9-ae4e223b25e2 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:30.033007 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-714d34c2-ada2-4907-a4b9-ae4e223b25e2 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:30.033437 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-714d34c2-ada2-4907-a4b9-ae4e223b25e2 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:30.056447 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-714d34c2-ada2-4907-a4b9-ae4e223b25e2 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/4ae413eb-83c0-48ab-818c-f75d9727d345/ips" status: 200 len: 149 microversion: 2.1 time: 0.039571 Aug 06 14:40:30.056999 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 490/1028] 10.222.0.17 () {58 vars in 1248 bytes} [Sat Aug 6 14:40:30 2022] GET /compute/v2.1/servers/4ae413eb-83c0-48ab-818c-f75d9727d345/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:40:32.436272 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-f19b82bf-eb3e-466c-91ec-4117483f3742 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "321f568e-91f8-44a9-8354-bfde0d0ee115"}} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:40:32.438738 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-f19b82bf-eb3e-466c-91ec-4117483f3742 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 4ae413eb-83c0-48ab-818c-f75d9727d345] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:40:32.440885 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=1 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:40:32.441520 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_cell1:SELECT=53,nova_cell1:INSERT=2 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:40:32.447562 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f19b82bf-eb3e-466c-91ec-4117483f3742 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:32.448046 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f19b82bf-eb3e-466c-91ec-4117483f3742 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:32.448479 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f19b82bf-eb3e-466c-91ec-4117483f3742 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:32.449165 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f19b82bf-eb3e-466c-91ec-4117483f3742 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:32.449738 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f19b82bf-eb3e-466c-91ec-4117483f3742 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:32.450022 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f19b82bf-eb3e-466c-91ec-4117483f3742 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:32.730286 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-f19b82bf-eb3e-466c-91ec-4117483f3742 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "POST /compute/v2.1/servers/4ae413eb-83c0-48ab-818c-f75d9727d345/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.299858 Aug 06 14:40:32.731656 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 539/1029] 10.222.0.17 () {60 vars in 1323 bytes} [Sat Aug 6 14:40:32 2022] POST /compute/v2.1/servers/4ae413eb-83c0-48ab-818c-f75d9727d345/os-volume_attachments => generated 194 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 14:40:40.657227 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-abbba5db-8948-4151-972f-9e8e55b64271 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:40:40.657713 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-abbba5db-8948-4151-972f-9e8e55b64271 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 4ae413eb-83c0-48ab-818c-f75d9727d345] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:40:40.660164 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_api:SELECT=2 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:40:40.660809 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_cell1:SELECT=4 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:40:40.666571 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-abbba5db-8948-4151-972f-9e8e55b64271 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:40.667097 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-abbba5db-8948-4151-972f-9e8e55b64271 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:40.667533 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-abbba5db-8948-4151-972f-9e8e55b64271 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:40.668225 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-abbba5db-8948-4151-972f-9e8e55b64271 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:40.668683 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-abbba5db-8948-4151-972f-9e8e55b64271 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:40.669110 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-abbba5db-8948-4151-972f-9e8e55b64271 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:40.747536 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.objects.instance [None req-abbba5db-8948-4151-972f-9e8e55b64271 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lazy-loading 'services' on Instance uuid 4ae413eb-83c0-48ab-818c-f75d9727d345 {{(pid=117838) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 14:40:40.817282 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-abbba5db-8948-4151-972f-9e8e55b64271 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4ae413eb-83c0-48ab-818c-f75d9727d345/os-volume_attachments/321f568e-91f8-44a9-8354-bfde0d0ee115" status: 202 len: 0 microversion: 2.1 time: 0.164552 Aug 06 14:40:40.817854 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 491/1030] 10.222.0.17 () {58 vars in 1416 bytes} [Sat Aug 6 14:40:40 2022] DELETE /compute/v2.1/servers/4ae413eb-83c0-48ab-818c-f75d9727d345/os-volume_attachments/321f568e-91f8-44a9-8354-bfde0d0ee115 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 14:40:40.827190 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-b681c63e-c486-4bf3-8a55-eb6fa07fbf0f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:40:40.830099 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-b681c63e-c486-4bf3-8a55-eb6fa07fbf0f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 4ae413eb-83c0-48ab-818c-f75d9727d345] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:40:40.836396 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b681c63e-c486-4bf3-8a55-eb6fa07fbf0f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:40.836881 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b681c63e-c486-4bf3-8a55-eb6fa07fbf0f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:40.837319 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b681c63e-c486-4bf3-8a55-eb6fa07fbf0f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:40.838011 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b681c63e-c486-4bf3-8a55-eb6fa07fbf0f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:40.838461 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b681c63e-c486-4bf3-8a55-eb6fa07fbf0f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:40.838899 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b681c63e-c486-4bf3-8a55-eb6fa07fbf0f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:40.870270 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-b681c63e-c486-4bf3-8a55-eb6fa07fbf0f tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/4ae413eb-83c0-48ab-818c-f75d9727d345/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047866 Aug 06 14:40:40.870822 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 540/1031] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Aug 6 14:40:40 2022] GET /compute/v2.1/servers/4ae413eb-83c0-48ab-818c-f75d9727d345/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:40:41.885706 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-db714681-9633-449e-9a0e-26ec283b52d7 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:40:41.888931 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-db714681-9633-449e-9a0e-26ec283b52d7 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 4ae413eb-83c0-48ab-818c-f75d9727d345] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:40:41.895476 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-db714681-9633-449e-9a0e-26ec283b52d7 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:41.895958 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-db714681-9633-449e-9a0e-26ec283b52d7 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:41.896391 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-db714681-9633-449e-9a0e-26ec283b52d7 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:41.897083 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-db714681-9633-449e-9a0e-26ec283b52d7 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:41.897535 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-db714681-9633-449e-9a0e-26ec283b52d7 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:41.897958 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-db714681-9633-449e-9a0e-26ec283b52d7 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:41.926512 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-db714681-9633-449e-9a0e-26ec283b52d7 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/4ae413eb-83c0-48ab-818c-f75d9727d345/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046741 Aug 06 14:40:41.927096 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 492/1032] 10.222.0.17 () {58 vars in 1302 bytes} [Sat Aug 6 14:40:41 2022] GET /compute/v2.1/servers/4ae413eb-83c0-48ab-818c-f75d9727d345/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 06 14:40:41.989673 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-6dd0d6eb-69db-46ab-9ac5-6a764baf9185 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:40:41.990148 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-6dd0d6eb-69db-46ab-9ac5-6a764baf9185 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 4ae413eb-83c0-48ab-818c-f75d9727d345] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:40:41.996458 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6dd0d6eb-69db-46ab-9ac5-6a764baf9185 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:41.996930 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6dd0d6eb-69db-46ab-9ac5-6a764baf9185 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:41.997360 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6dd0d6eb-69db-46ab-9ac5-6a764baf9185 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:41.998036 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6dd0d6eb-69db-46ab-9ac5-6a764baf9185 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:41.998487 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6dd0d6eb-69db-46ab-9ac5-6a764baf9185 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:41.998921 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6dd0d6eb-69db-46ab-9ac5-6a764baf9185 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:42.023239 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-6dd0d6eb-69db-46ab-9ac5-6a764baf9185 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 4ae413eb-83c0-48ab-818c-f75d9727d345] Going to try to terminate instance {{(pid=117837) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 14:40:42.095819 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-6dd0d6eb-69db-46ab-9ac5-6a764baf9185 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4ae413eb-83c0-48ab-818c-f75d9727d345" status: 204 len: 0 microversion: 2.1 time: 0.109696 Aug 06 14:40:42.096498 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 541/1033] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Aug 6 14:40:41 2022] DELETE /compute/v2.1/servers/4ae413eb-83c0-48ab-818c-f75d9727d345 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 14:40:42.104748 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-bdfd136d-dbeb-46cd-95a5-f28a3aabf4b0 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:40:42.105359 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-bdfd136d-dbeb-46cd-95a5-f28a3aabf4b0 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 4ae413eb-83c0-48ab-818c-f75d9727d345] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:40:42.111771 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-bdfd136d-dbeb-46cd-95a5-f28a3aabf4b0 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:42.112252 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-bdfd136d-dbeb-46cd-95a5-f28a3aabf4b0 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:42.112686 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-bdfd136d-dbeb-46cd-95a5-f28a3aabf4b0 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:42.113368 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-bdfd136d-dbeb-46cd-95a5-f28a3aabf4b0 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:42.113823 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-bdfd136d-dbeb-46cd-95a5-f28a3aabf4b0 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:42.114245 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-bdfd136d-dbeb-46cd-95a5-f28a3aabf4b0 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:42.246073 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-bdfd136d-dbeb-46cd-95a5-f28a3aabf4b0 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:40:42.253535 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-bdfd136d-dbeb-46cd-95a5-f28a3aabf4b0 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/4ae413eb-83c0-48ab-818c-f75d9727d345" status: 200 len: 1680 microversion: 2.1 time: 0.152598 Aug 06 14:40:42.254084 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 493/1034] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:40:42 2022] GET /compute/v2.1/servers/4ae413eb-83c0-48ab-818c-f75d9727d345 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:40:43.274908 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-f9422ad9-ac2c-438e-991a-ec76facffd85 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:40:43.275626 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-f9422ad9-ac2c-438e-991a-ec76facffd85 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 4ae413eb-83c0-48ab-818c-f75d9727d345] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:40:43.282103 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f9422ad9-ac2c-438e-991a-ec76facffd85 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:43.282592 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f9422ad9-ac2c-438e-991a-ec76facffd85 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:43.283063 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f9422ad9-ac2c-438e-991a-ec76facffd85 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:43.283787 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f9422ad9-ac2c-438e-991a-ec76facffd85 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:43.284240 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f9422ad9-ac2c-438e-991a-ec76facffd85 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:43.284666 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f9422ad9-ac2c-438e-991a-ec76facffd85 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:43.412887 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-f9422ad9-ac2c-438e-991a-ec76facffd85 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:40:43.422689 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-f9422ad9-ac2c-438e-991a-ec76facffd85 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/4ae413eb-83c0-48ab-818c-f75d9727d345" status: 200 len: 1680 microversion: 2.1 time: 0.151634 Aug 06 14:40:43.423282 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 542/1035] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:40:43 2022] GET /compute/v2.1/servers/4ae413eb-83c0-48ab-818c-f75d9727d345 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:40:44.444607 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-2b2aa3d5-0009-448d-87b6-5371f6876605 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:40:44.445146 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-2b2aa3d5-0009-448d-87b6-5371f6876605 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 4ae413eb-83c0-48ab-818c-f75d9727d345] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:40:44.451591 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2b2aa3d5-0009-448d-87b6-5371f6876605 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:44.452069 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2b2aa3d5-0009-448d-87b6-5371f6876605 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:44.452496 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2b2aa3d5-0009-448d-87b6-5371f6876605 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:44.453760 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2b2aa3d5-0009-448d-87b6-5371f6876605 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:44.454212 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2b2aa3d5-0009-448d-87b6-5371f6876605 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:44.454629 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2b2aa3d5-0009-448d-87b6-5371f6876605 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:44.587539 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-2b2aa3d5-0009-448d-87b6-5371f6876605 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:40:44.595107 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-2b2aa3d5-0009-448d-87b6-5371f6876605 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/4ae413eb-83c0-48ab-818c-f75d9727d345" status: 200 len: 1680 microversion: 2.1 time: 0.154387 Aug 06 14:40:44.595672 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 494/1036] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:40:44 2022] GET /compute/v2.1/servers/4ae413eb-83c0-48ab-818c-f75d9727d345 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:40:45.252390 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [req-fbfbf9df-7153-4708-8207-d6d141b4f7e0 req-f7325f3b-4dae-482b-9620-da627452d1b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ae413eb-83c0-48ab-818c-f75d9727d345", "name": "network-vif-deleted", "tag": "12dea44a-bac1-426f-adfb-65593fd7191e"}]} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:40:45.262376 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-fbfbf9df-7153-4708-8207-d6d141b4f7e0 req-f7325f3b-4dae-482b-9620-da627452d1b2 service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:45.262899 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-fbfbf9df-7153-4708-8207-d6d141b4f7e0 req-f7325f3b-4dae-482b-9620-da627452d1b2 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:45.263333 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-fbfbf9df-7153-4708-8207-d6d141b4f7e0 req-f7325f3b-4dae-482b-9620-da627452d1b2 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:45.276260 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.compute.server_external_events [req-fbfbf9df-7153-4708-8207-d6d141b4f7e0 req-f7325f3b-4dae-482b-9620-da627452d1b2 service nova] Creating event network-vif-deleted:12dea44a-bac1-426f-adfb-65593fd7191e for instance 4ae413eb-83c0-48ab-818c-f75d9727d345 on hv-cinder-85199 Aug 06 14:40:45.282396 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [req-fbfbf9df-7153-4708-8207-d6d141b4f7e0 req-f7325f3b-4dae-482b-9620-da627452d1b2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033523 Aug 06 14:40:45.283240 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 543/1037] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:40:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:40:45.617613 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-62ef4c24-5c1c-45ae-97ed-12feda464947 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:40:45.618226 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-62ef4c24-5c1c-45ae-97ed-12feda464947 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 4ae413eb-83c0-48ab-818c-f75d9727d345] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:40:45.624769 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-62ef4c24-5c1c-45ae-97ed-12feda464947 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:45.625252 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-62ef4c24-5c1c-45ae-97ed-12feda464947 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:45.625686 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-62ef4c24-5c1c-45ae-97ed-12feda464947 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:45.626401 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-62ef4c24-5c1c-45ae-97ed-12feda464947 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:45.626836 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-62ef4c24-5c1c-45ae-97ed-12feda464947 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:45.627286 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-62ef4c24-5c1c-45ae-97ed-12feda464947 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:45.660162 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-62ef4c24-5c1c-45ae-97ed-12feda464947 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:45.660645 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-62ef4c24-5c1c-45ae-97ed-12feda464947 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:45.661084 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-62ef4c24-5c1c-45ae-97ed-12feda464947 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:45.661534 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.objects.instance [None req-62ef4c24-5c1c-45ae-97ed-12feda464947 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lazy-loading 'fault' on Instance uuid 4ae413eb-83c0-48ab-818c-f75d9727d345 {{(pid=117838) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 14:40:45.704343 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-62ef4c24-5c1c-45ae-97ed-12feda464947 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5378c85cd31c42dfbc39ce738a8b6dde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96a7bb12d3ed4d1db2a58a03472483c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:40:45.712846 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-62ef4c24-5c1c-45ae-97ed-12feda464947 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/4ae413eb-83c0-48ab-818c-f75d9727d345" status: 200 len: 1330 microversion: 2.1 time: 0.099132 Aug 06 14:40:45.719317 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 495/1038] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:40:45 2022] GET /compute/v2.1/servers/4ae413eb-83c0-48ab-818c-f75d9727d345 => generated 1330 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:40:46.735196 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-7c05742d-f7d5-47d8-9299-d53b3b26161e tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:40:46.735897 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-7c05742d-f7d5-47d8-9299-d53b3b26161e tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 4ae413eb-83c0-48ab-818c-f75d9727d345] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:40:46.742047 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7c05742d-f7d5-47d8-9299-d53b3b26161e tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:46.742531 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7c05742d-f7d5-47d8-9299-d53b3b26161e tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:46.743013 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7c05742d-f7d5-47d8-9299-d53b3b26161e tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:46.743703 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7c05742d-f7d5-47d8-9299-d53b3b26161e tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:46.744158 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7c05742d-f7d5-47d8-9299-d53b3b26161e tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:46.744612 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-7c05742d-f7d5-47d8-9299-d53b3b26161e tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:46.758383 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.wsgi [None req-7c05742d-f7d5-47d8-9299-d53b3b26161e tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] HTTP exception thrown: Instance 4ae413eb-83c0-48ab-818c-f75d9727d345 could not be found. Aug 06 14:40:46.760054 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-7c05742d-f7d5-47d8-9299-d53b3b26161e tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Request method failure captured: Aug 06 14:40:46.760054 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: request: GET /compute/v2.1/servers/4ae413eb-83c0-48ab-818c-f75d9727d345 HTTP/1.1 Aug 06 14:40:46.760054 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Accept: application/json Aug 06 14:40:46.760054 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Accept-Encoding: identity Aug 06 14:40:46.760054 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Connection: close Aug 06 14:40:46.760054 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Content-Length: 0 Aug 06 14:40:46.760054 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Content-Type: application/json Aug 06 14:40:46.760054 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Host: 10.222.0.17 Aug 06 14:40:46.760054 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Openstack-System-Scope: None Aug 06 14:40:46.760054 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: User-Agent: python-urllib3/1.26.11 Aug 06 14:40:46.760054 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Auth-Token: gAAAAABi7nrw1j_Ge2Ur2tEojXwBmjEDUihl-N8v1g20aSIVDaeL_OTgCZQS1IFihI0AmtEC1h-SgLRiudvycNkR7KjoTpqo7M5425d9Dy_4zXKbCfizwmIbraJL9PsVC3rQgInSWh6L4pF_pLJlUkvGCOVZ6ElDrY4gMQsJ7uwAoVwYy3EWJq0 Aug 06 14:40:46.760054 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Domain-Id: None Aug 06 14:40:46.760054 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Domain-Name: None Aug 06 14:40:46.760054 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Identity-Status: Confirmed Aug 06 14:40:46.760054 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Is-Admin-Project: True Aug 06 14:40:46.760054 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Domain-Id: default Aug 06 14:40:46.760054 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Domain-Name: Default Aug 06 14:40:46.760054 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Id: 96a7bb12d3ed4d1db2a58a03472483c2 Aug 06 14:40:46.760054 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Name: tempest-AttachVolumeNegativeTest-927490997 Aug 06 14:40:46.760054 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Role: member,reader Aug 06 14:40:46.760054 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Roles: member,reader Aug 06 14:40:46.761747 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/96a7bb12d3ed4d1db2a58a03472483c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/96a7bb12d3ed4d1db2a58a03472483c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_96a7bb12d3ed4d1db2a58a03472483c2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/96a7bb12d3ed4d1db2a58a03472483c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 06 14:40:46.761747 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant: tempest-AttachVolumeNegativeTest-927490997 Aug 06 14:40:46.761747 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant-Id: 96a7bb12d3ed4d1db2a58a03472483c2 Aug 06 14:40:46.761747 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-927490997 Aug 06 14:40:46.761747 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User: tempest-AttachVolumeNegativeTest-927490997-project Aug 06 14:40:46.761747 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Domain-Id: default Aug 06 14:40:46.761747 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Domain-Name: Default Aug 06 14:40:46.761747 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Id: 5378c85cd31c42dfbc39ce738a8b6dde Aug 06 14:40:46.761747 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Name: tempest-AttachVolumeNegativeTest-927490997-project Aug 06 14:40:46.761747 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: method: > Aug 06 14:40:46.761747 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: exception: Instance 4ae413eb-83c0-48ab-818c-f75d9727d345 could not be found. Aug 06 14:40:46.761747 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: action_args: {'id': '4ae413eb-83c0-48ab-818c-f75d9727d345'} Aug 06 14:40:46.762849 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 14:40:46.762849 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:40:46.762849 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 14:40:46.762849 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 14:40:46.762849 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 14:40:46.762849 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 14:40:46.762849 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 14:40:46.762849 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 14:40:46.762849 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 14:40:46.762849 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 14:40:46.762849 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ae413eb-83c0-48ab-818c-f75d9727d345 could not be found. Aug 06 14:40:46.762849 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:40:46.762849 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:40:46.762849 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:40:46.762849 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:40:46.762849 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:40:46.762849 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:40:46.762849 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 14:40:46.762849 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 14:40:46.762849 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 14:40:46.764450 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 14:40:46.764450 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 14:40:46.764450 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 14:40:46.764450 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 14:40:46.764450 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 14:40:46.764450 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 14:40:46.764450 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 14:40:46.764450 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ae413eb-83c0-48ab-818c-f75d9727d345 could not be found. Aug 06 14:40:46.764450 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:40:46.764450 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:40:46.764450 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:40:46.764450 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:40:46.764450 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:40:46.764450 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:40:46.764450 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 14:40:46.764450 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 14:40:46.764450 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ae413eb-83c0-48ab-818c-f75d9727d345 could not be found. Aug 06 14:40:46.764450 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:40:46.766583 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-7c05742d-f7d5-47d8-9299-d53b3b26161e tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Returning 404 to user: Instance 4ae413eb-83c0-48ab-818c-f75d9727d345 could not be found. {{(pid=117837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 14:40:46.766583 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-7c05742d-f7d5-47d8-9299-d53b3b26161e tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/4ae413eb-83c0-48ab-818c-f75d9727d345" status: 404 len: 111 microversion: 2.1 time: 0.030981 Aug 06 14:40:46.766583 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 544/1039] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:40:46 2022] GET /compute/v2.1/servers/4ae413eb-83c0-48ab-818c-f75d9727d345 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 14:40:46.770886 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-3d86e2e1-a573-4287-868f-7f4b57555b8c tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '.version_select at 0x7fbab21149d0>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:40:46.790007 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-3d86e2e1-a573-4287-868f-7f4b57555b8c tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-735452006" status: 202 len: 0 microversion: 2.1 time: 0.022945 Aug 06 14:40:46.790552 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 496/1040] 10.222.0.17 () {58 vars in 1218 bytes} [Sat Aug 6 14:40:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-735452006 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 14:40:48.541980 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-189672c7-f172-4390-9a75-bdcd47033b72 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:40:48.542482 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-189672c7-f172-4390-9a75-bdcd47033b72 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 4ae413eb-83c0-48ab-818c-f75d9727d345] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:40:48.548906 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-189672c7-f172-4390-9a75-bdcd47033b72 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:48.549416 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-189672c7-f172-4390-9a75-bdcd47033b72 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:48.549847 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-189672c7-f172-4390-9a75-bdcd47033b72 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:48.550535 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-189672c7-f172-4390-9a75-bdcd47033b72 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:48.551063 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-189672c7-f172-4390-9a75-bdcd47033b72 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:48.551428 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-189672c7-f172-4390-9a75-bdcd47033b72 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:48.565780 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.wsgi [None req-189672c7-f172-4390-9a75-bdcd47033b72 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] HTTP exception thrown: Instance 4ae413eb-83c0-48ab-818c-f75d9727d345 could not be found. Aug 06 14:40:48.567455 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-189672c7-f172-4390-9a75-bdcd47033b72 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Request method failure captured: Aug 06 14:40:48.567455 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: request: DELETE /compute/v2.1/servers/4ae413eb-83c0-48ab-818c-f75d9727d345 HTTP/1.1 Aug 06 14:40:48.567455 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Accept: application/json Aug 06 14:40:48.567455 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Accept-Encoding: identity Aug 06 14:40:48.567455 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Connection: close Aug 06 14:40:48.567455 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Content-Length: 0 Aug 06 14:40:48.567455 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Content-Type: application/json Aug 06 14:40:48.567455 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Host: 10.222.0.17 Aug 06 14:40:48.567455 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Openstack-System-Scope: None Aug 06 14:40:48.567455 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: User-Agent: python-urllib3/1.26.11 Aug 06 14:40:48.567455 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Auth-Token: gAAAAABi7nrw1j_Ge2Ur2tEojXwBmjEDUihl-N8v1g20aSIVDaeL_OTgCZQS1IFihI0AmtEC1h-SgLRiudvycNkR7KjoTpqo7M5425d9Dy_4zXKbCfizwmIbraJL9PsVC3rQgInSWh6L4pF_pLJlUkvGCOVZ6ElDrY4gMQsJ7uwAoVwYy3EWJq0 Aug 06 14:40:48.567455 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Domain-Id: None Aug 06 14:40:48.567455 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Domain-Name: None Aug 06 14:40:48.567455 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Identity-Status: Confirmed Aug 06 14:40:48.567455 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Is-Admin-Project: True Aug 06 14:40:48.567455 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Domain-Id: default Aug 06 14:40:48.567455 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Domain-Name: Default Aug 06 14:40:48.567455 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Id: 96a7bb12d3ed4d1db2a58a03472483c2 Aug 06 14:40:48.567455 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Name: tempest-AttachVolumeNegativeTest-927490997 Aug 06 14:40:48.567455 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Role: member,reader Aug 06 14:40:48.567455 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Roles: member,reader Aug 06 14:40:48.569026 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/96a7bb12d3ed4d1db2a58a03472483c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/96a7bb12d3ed4d1db2a58a03472483c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_96a7bb12d3ed4d1db2a58a03472483c2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/96a7bb12d3ed4d1db2a58a03472483c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 06 14:40:48.569026 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant: tempest-AttachVolumeNegativeTest-927490997 Aug 06 14:40:48.569026 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant-Id: 96a7bb12d3ed4d1db2a58a03472483c2 Aug 06 14:40:48.569026 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-927490997 Aug 06 14:40:48.569026 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User: tempest-AttachVolumeNegativeTest-927490997-project Aug 06 14:40:48.569026 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Domain-Id: default Aug 06 14:40:48.569026 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Domain-Name: Default Aug 06 14:40:48.569026 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Id: 5378c85cd31c42dfbc39ce738a8b6dde Aug 06 14:40:48.569026 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Name: tempest-AttachVolumeNegativeTest-927490997-project Aug 06 14:40:48.569026 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: method: > Aug 06 14:40:48.569026 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: exception: Instance 4ae413eb-83c0-48ab-818c-f75d9727d345 could not be found. Aug 06 14:40:48.569026 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: action_args: {'id': '4ae413eb-83c0-48ab-818c-f75d9727d345'} Aug 06 14:40:48.573415 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 14:40:48.573415 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:40:48.573415 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 14:40:48.573415 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 14:40:48.573415 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 14:40:48.573415 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 14:40:48.573415 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 14:40:48.573415 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 14:40:48.573415 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 14:40:48.573415 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 14:40:48.573415 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ae413eb-83c0-48ab-818c-f75d9727d345 could not be found. Aug 06 14:40:48.573415 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:40:48.573415 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:40:48.573415 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:40:48.573415 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:40:48.573415 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:40:48.573415 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:40:48.573415 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 14:40:48.573415 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 14:40:48.573415 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 14:40:48.575188 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 14:40:48.575188 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 14:40:48.575188 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 14:40:48.575188 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 14:40:48.575188 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 14:40:48.575188 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 14:40:48.575188 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 14:40:48.575188 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 14:40:48.575188 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 14:40:48.575188 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ae413eb-83c0-48ab-818c-f75d9727d345 could not be found. Aug 06 14:40:48.575188 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:40:48.575188 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:40:48.575188 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:40:48.575188 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:40:48.575188 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:40:48.575188 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:40:48.575188 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 14:40:48.575188 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 14:40:48.575188 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ae413eb-83c0-48ab-818c-f75d9727d345 could not be found. Aug 06 14:40:48.575188 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:40:48.576813 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-189672c7-f172-4390-9a75-bdcd47033b72 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Returning 404 to user: Instance 4ae413eb-83c0-48ab-818c-f75d9727d345 could not be found. {{(pid=117837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 14:40:48.576813 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-189672c7-f172-4390-9a75-bdcd47033b72 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "DELETE /compute/v2.1/servers/4ae413eb-83c0-48ab-818c-f75d9727d345" status: 404 len: 111 microversion: 2.1 time: 0.030594 Aug 06 14:40:48.576813 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 545/1041] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Aug 6 14:40:48 2022] DELETE /compute/v2.1/servers/4ae413eb-83c0-48ab-818c-f75d9727d345 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 14:40:48.581716 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-805f398c-4545-4725-ad30-05f597105beb tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:40:48.582481 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-805f398c-4545-4725-ad30-05f597105beb tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 4ae413eb-83c0-48ab-818c-f75d9727d345] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:40:48.590081 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-805f398c-4545-4725-ad30-05f597105beb tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:48.590700 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-805f398c-4545-4725-ad30-05f597105beb tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:48.591230 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-805f398c-4545-4725-ad30-05f597105beb tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:48.593011 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-805f398c-4545-4725-ad30-05f597105beb tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:48.593683 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-805f398c-4545-4725-ad30-05f597105beb tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:48.594717 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-805f398c-4545-4725-ad30-05f597105beb tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:48.610582 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.wsgi [None req-805f398c-4545-4725-ad30-05f597105beb tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] HTTP exception thrown: Instance 4ae413eb-83c0-48ab-818c-f75d9727d345 could not be found. Aug 06 14:40:48.612284 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-805f398c-4545-4725-ad30-05f597105beb tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Request method failure captured: Aug 06 14:40:48.612284 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: request: GET /compute/v2.1/servers/4ae413eb-83c0-48ab-818c-f75d9727d345 HTTP/1.1 Aug 06 14:40:48.612284 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Accept: application/json Aug 06 14:40:48.612284 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Accept-Encoding: identity Aug 06 14:40:48.612284 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Connection: close Aug 06 14:40:48.612284 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Content-Length: 0 Aug 06 14:40:48.612284 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Content-Type: application/json Aug 06 14:40:48.612284 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Host: 10.222.0.17 Aug 06 14:40:48.612284 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Openstack-System-Scope: None Aug 06 14:40:48.612284 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: User-Agent: python-urllib3/1.26.11 Aug 06 14:40:48.612284 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Auth-Token: gAAAAABi7nrw1j_Ge2Ur2tEojXwBmjEDUihl-N8v1g20aSIVDaeL_OTgCZQS1IFihI0AmtEC1h-SgLRiudvycNkR7KjoTpqo7M5425d9Dy_4zXKbCfizwmIbraJL9PsVC3rQgInSWh6L4pF_pLJlUkvGCOVZ6ElDrY4gMQsJ7uwAoVwYy3EWJq0 Aug 06 14:40:48.612284 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Domain-Id: None Aug 06 14:40:48.612284 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Domain-Name: None Aug 06 14:40:48.612284 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Identity-Status: Confirmed Aug 06 14:40:48.612284 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Is-Admin-Project: True Aug 06 14:40:48.612284 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Domain-Id: default Aug 06 14:40:48.612284 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Domain-Name: Default Aug 06 14:40:48.612284 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Id: 96a7bb12d3ed4d1db2a58a03472483c2 Aug 06 14:40:48.612284 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Name: tempest-AttachVolumeNegativeTest-927490997 Aug 06 14:40:48.612284 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Role: member,reader Aug 06 14:40:48.612284 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Roles: member,reader Aug 06 14:40:48.613893 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/96a7bb12d3ed4d1db2a58a03472483c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/96a7bb12d3ed4d1db2a58a03472483c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_96a7bb12d3ed4d1db2a58a03472483c2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/96a7bb12d3ed4d1db2a58a03472483c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 06 14:40:48.613893 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Tenant: tempest-AttachVolumeNegativeTest-927490997 Aug 06 14:40:48.613893 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Tenant-Id: 96a7bb12d3ed4d1db2a58a03472483c2 Aug 06 14:40:48.613893 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-927490997 Aug 06 14:40:48.613893 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User: tempest-AttachVolumeNegativeTest-927490997-project Aug 06 14:40:48.613893 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Domain-Id: default Aug 06 14:40:48.613893 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Domain-Name: Default Aug 06 14:40:48.613893 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Id: 5378c85cd31c42dfbc39ce738a8b6dde Aug 06 14:40:48.613893 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Name: tempest-AttachVolumeNegativeTest-927490997-project Aug 06 14:40:48.613893 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: method: > Aug 06 14:40:48.613893 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: exception: Instance 4ae413eb-83c0-48ab-818c-f75d9727d345 could not be found. Aug 06 14:40:48.613893 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: action_args: {'id': '4ae413eb-83c0-48ab-818c-f75d9727d345'} Aug 06 14:40:48.614781 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 14:40:48.614781 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:40:48.614781 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 14:40:48.614781 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 14:40:48.614781 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 14:40:48.614781 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 14:40:48.614781 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 14:40:48.614781 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 14:40:48.614781 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 14:40:48.614781 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 14:40:48.614781 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ae413eb-83c0-48ab-818c-f75d9727d345 could not be found. Aug 06 14:40:48.614781 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:40:48.614781 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:40:48.614781 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:40:48.614781 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:40:48.614781 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:40:48.614781 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:40:48.614781 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 14:40:48.614781 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 14:40:48.614781 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 14:40:48.616309 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 14:40:48.616309 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 14:40:48.616309 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 14:40:48.616309 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 14:40:48.616309 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 14:40:48.616309 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 14:40:48.616309 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 14:40:48.616309 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ae413eb-83c0-48ab-818c-f75d9727d345 could not be found. Aug 06 14:40:48.616309 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:40:48.616309 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:40:48.616309 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:40:48.616309 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:40:48.616309 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:40:48.616309 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:40:48.616309 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 14:40:48.616309 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 14:40:48.616309 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ae413eb-83c0-48ab-818c-f75d9727d345 could not be found. Aug 06 14:40:48.616309 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:40:48.617773 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-805f398c-4545-4725-ad30-05f597105beb tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Returning 404 to user: Instance 4ae413eb-83c0-48ab-818c-f75d9727d345 could not be found. {{(pid=117838) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 14:40:48.617773 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-805f398c-4545-4725-ad30-05f597105beb tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/4ae413eb-83c0-48ab-818c-f75d9727d345" status: 404 len: 111 microversion: 2.1 time: 0.036929 Aug 06 14:40:48.617773 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 497/1042] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:40:48 2022] GET /compute/v2.1/servers/4ae413eb-83c0-48ab-818c-f75d9727d345 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 14:40:49.759488 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-dbe0e49b-dc63-4529-8397-23e0627c19a2 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:40:49.759984 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-dbe0e49b-dc63-4529-8397-23e0627c19a2 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6d80056a-5ade-4f3b-8e08-adf707c34cfe] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:40:49.766250 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-dbe0e49b-dc63-4529-8397-23e0627c19a2 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:49.766724 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-dbe0e49b-dc63-4529-8397-23e0627c19a2 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:49.767194 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-dbe0e49b-dc63-4529-8397-23e0627c19a2 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:49.767875 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-dbe0e49b-dc63-4529-8397-23e0627c19a2 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:49.768324 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-dbe0e49b-dc63-4529-8397-23e0627c19a2 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:49.768740 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-dbe0e49b-dc63-4529-8397-23e0627c19a2 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:49.784639 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.wsgi [None req-dbe0e49b-dc63-4529-8397-23e0627c19a2 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] HTTP exception thrown: Instance 6d80056a-5ade-4f3b-8e08-adf707c34cfe could not be found. Aug 06 14:40:49.786168 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-dbe0e49b-dc63-4529-8397-23e0627c19a2 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Request method failure captured: Aug 06 14:40:49.786168 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: request: DELETE /compute/v2.1/servers/6d80056a-5ade-4f3b-8e08-adf707c34cfe HTTP/1.1 Aug 06 14:40:49.786168 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Accept: application/json Aug 06 14:40:49.786168 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Accept-Encoding: identity Aug 06 14:40:49.786168 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Connection: close Aug 06 14:40:49.786168 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Content-Length: 0 Aug 06 14:40:49.786168 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Content-Type: application/json Aug 06 14:40:49.786168 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Host: 10.222.0.17 Aug 06 14:40:49.786168 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Openstack-System-Scope: None Aug 06 14:40:49.786168 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: User-Agent: python-urllib3/1.26.11 Aug 06 14:40:49.786168 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Auth-Token: gAAAAABi7nrw1j_Ge2Ur2tEojXwBmjEDUihl-N8v1g20aSIVDaeL_OTgCZQS1IFihI0AmtEC1h-SgLRiudvycNkR7KjoTpqo7M5425d9Dy_4zXKbCfizwmIbraJL9PsVC3rQgInSWh6L4pF_pLJlUkvGCOVZ6ElDrY4gMQsJ7uwAoVwYy3EWJq0 Aug 06 14:40:49.786168 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Domain-Id: None Aug 06 14:40:49.786168 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Domain-Name: None Aug 06 14:40:49.786168 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Identity-Status: Confirmed Aug 06 14:40:49.786168 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Is-Admin-Project: True Aug 06 14:40:49.786168 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Domain-Id: default Aug 06 14:40:49.786168 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Domain-Name: Default Aug 06 14:40:49.786168 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Id: 96a7bb12d3ed4d1db2a58a03472483c2 Aug 06 14:40:49.786168 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Name: tempest-AttachVolumeNegativeTest-927490997 Aug 06 14:40:49.786168 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Role: member,reader Aug 06 14:40:49.786168 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Roles: member,reader Aug 06 14:40:49.787880 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/96a7bb12d3ed4d1db2a58a03472483c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/96a7bb12d3ed4d1db2a58a03472483c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_96a7bb12d3ed4d1db2a58a03472483c2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/96a7bb12d3ed4d1db2a58a03472483c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 06 14:40:49.787880 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant: tempest-AttachVolumeNegativeTest-927490997 Aug 06 14:40:49.787880 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant-Id: 96a7bb12d3ed4d1db2a58a03472483c2 Aug 06 14:40:49.787880 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-927490997 Aug 06 14:40:49.787880 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User: tempest-AttachVolumeNegativeTest-927490997-project Aug 06 14:40:49.787880 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Domain-Id: default Aug 06 14:40:49.787880 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Domain-Name: Default Aug 06 14:40:49.787880 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Id: 5378c85cd31c42dfbc39ce738a8b6dde Aug 06 14:40:49.787880 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Name: tempest-AttachVolumeNegativeTest-927490997-project Aug 06 14:40:49.787880 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: method: > Aug 06 14:40:49.787880 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: exception: Instance 6d80056a-5ade-4f3b-8e08-adf707c34cfe could not be found. Aug 06 14:40:49.787880 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: action_args: {'id': '6d80056a-5ade-4f3b-8e08-adf707c34cfe'} Aug 06 14:40:49.788904 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 14:40:49.788904 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:40:49.788904 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 14:40:49.788904 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 14:40:49.788904 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 14:40:49.788904 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 14:40:49.788904 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 14:40:49.788904 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 14:40:49.788904 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 14:40:49.788904 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 14:40:49.788904 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d80056a-5ade-4f3b-8e08-adf707c34cfe could not be found. Aug 06 14:40:49.788904 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:40:49.788904 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:40:49.788904 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:40:49.788904 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:40:49.788904 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:40:49.788904 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:40:49.788904 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 14:40:49.788904 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 14:40:49.788904 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 14:40:49.790343 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 14:40:49.790343 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 14:40:49.790343 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 14:40:49.790343 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 14:40:49.790343 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 14:40:49.790343 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 14:40:49.790343 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 14:40:49.790343 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 14:40:49.790343 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 14:40:49.790343 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d80056a-5ade-4f3b-8e08-adf707c34cfe could not be found. Aug 06 14:40:49.790343 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:40:49.790343 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:40:49.790343 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:40:49.790343 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:40:49.790343 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:40:49.790343 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:40:49.790343 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 14:40:49.790343 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 14:40:49.790343 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d80056a-5ade-4f3b-8e08-adf707c34cfe could not be found. Aug 06 14:40:49.790343 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:40:49.792327 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-dbe0e49b-dc63-4529-8397-23e0627c19a2 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Returning 404 to user: Instance 6d80056a-5ade-4f3b-8e08-adf707c34cfe could not be found. {{(pid=117837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 14:40:49.792327 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-dbe0e49b-dc63-4529-8397-23e0627c19a2 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "DELETE /compute/v2.1/servers/6d80056a-5ade-4f3b-8e08-adf707c34cfe" status: 404 len: 111 microversion: 2.1 time: 0.031886 Aug 06 14:40:49.792327 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 546/1043] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Aug 6 14:40:49 2022] DELETE /compute/v2.1/servers/6d80056a-5ade-4f3b-8e08-adf707c34cfe => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 14:40:49.795974 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-b7310e6d-f651-4110-99a0-087cd03fdae1 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:40:49.796586 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-b7310e6d-f651-4110-99a0-087cd03fdae1 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6d80056a-5ade-4f3b-8e08-adf707c34cfe] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:40:49.803418 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b7310e6d-f651-4110-99a0-087cd03fdae1 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:49.803889 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b7310e6d-f651-4110-99a0-087cd03fdae1 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:49.804320 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b7310e6d-f651-4110-99a0-087cd03fdae1 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:49.805001 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b7310e6d-f651-4110-99a0-087cd03fdae1 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:49.805447 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b7310e6d-f651-4110-99a0-087cd03fdae1 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:49.805864 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b7310e6d-f651-4110-99a0-087cd03fdae1 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:49.821836 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.wsgi [None req-b7310e6d-f651-4110-99a0-087cd03fdae1 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] HTTP exception thrown: Instance 6d80056a-5ade-4f3b-8e08-adf707c34cfe could not be found. Aug 06 14:40:49.823378 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-b7310e6d-f651-4110-99a0-087cd03fdae1 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Request method failure captured: Aug 06 14:40:49.823378 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: request: GET /compute/v2.1/servers/6d80056a-5ade-4f3b-8e08-adf707c34cfe HTTP/1.1 Aug 06 14:40:49.823378 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Accept: application/json Aug 06 14:40:49.823378 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Accept-Encoding: identity Aug 06 14:40:49.823378 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Connection: close Aug 06 14:40:49.823378 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Content-Length: 0 Aug 06 14:40:49.823378 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Content-Type: application/json Aug 06 14:40:49.823378 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Host: 10.222.0.17 Aug 06 14:40:49.823378 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Openstack-System-Scope: None Aug 06 14:40:49.823378 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: User-Agent: python-urllib3/1.26.11 Aug 06 14:40:49.823378 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Auth-Token: gAAAAABi7nrw1j_Ge2Ur2tEojXwBmjEDUihl-N8v1g20aSIVDaeL_OTgCZQS1IFihI0AmtEC1h-SgLRiudvycNkR7KjoTpqo7M5425d9Dy_4zXKbCfizwmIbraJL9PsVC3rQgInSWh6L4pF_pLJlUkvGCOVZ6ElDrY4gMQsJ7uwAoVwYy3EWJq0 Aug 06 14:40:49.823378 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Domain-Id: None Aug 06 14:40:49.823378 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Domain-Name: None Aug 06 14:40:49.823378 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Identity-Status: Confirmed Aug 06 14:40:49.823378 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Is-Admin-Project: True Aug 06 14:40:49.823378 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Domain-Id: default Aug 06 14:40:49.823378 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Domain-Name: Default Aug 06 14:40:49.823378 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Id: 96a7bb12d3ed4d1db2a58a03472483c2 Aug 06 14:40:49.823378 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Name: tempest-AttachVolumeNegativeTest-927490997 Aug 06 14:40:49.823378 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Role: member,reader Aug 06 14:40:49.823378 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Roles: member,reader Aug 06 14:40:49.824929 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/96a7bb12d3ed4d1db2a58a03472483c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/96a7bb12d3ed4d1db2a58a03472483c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_96a7bb12d3ed4d1db2a58a03472483c2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/96a7bb12d3ed4d1db2a58a03472483c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 06 14:40:49.824929 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Tenant: tempest-AttachVolumeNegativeTest-927490997 Aug 06 14:40:49.824929 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Tenant-Id: 96a7bb12d3ed4d1db2a58a03472483c2 Aug 06 14:40:49.824929 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-927490997 Aug 06 14:40:49.824929 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User: tempest-AttachVolumeNegativeTest-927490997-project Aug 06 14:40:49.824929 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Domain-Id: default Aug 06 14:40:49.824929 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Domain-Name: Default Aug 06 14:40:49.824929 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Id: 5378c85cd31c42dfbc39ce738a8b6dde Aug 06 14:40:49.824929 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Name: tempest-AttachVolumeNegativeTest-927490997-project Aug 06 14:40:49.824929 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: method: > Aug 06 14:40:49.824929 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: exception: Instance 6d80056a-5ade-4f3b-8e08-adf707c34cfe could not be found. Aug 06 14:40:49.824929 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: action_args: {'id': '6d80056a-5ade-4f3b-8e08-adf707c34cfe'} Aug 06 14:40:49.825995 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 14:40:49.825995 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:40:49.825995 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 14:40:49.825995 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 14:40:49.825995 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 14:40:49.825995 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 14:40:49.825995 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 14:40:49.825995 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 14:40:49.825995 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 14:40:49.825995 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 14:40:49.825995 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d80056a-5ade-4f3b-8e08-adf707c34cfe could not be found. Aug 06 14:40:49.825995 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:40:49.825995 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:40:49.825995 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:40:49.825995 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:40:49.825995 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:40:49.825995 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:40:49.825995 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 14:40:49.825995 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 14:40:49.825995 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 14:40:49.827498 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 14:40:49.827498 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 14:40:49.827498 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 14:40:49.827498 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 14:40:49.827498 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 14:40:49.827498 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 14:40:49.827498 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 14:40:49.827498 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d80056a-5ade-4f3b-8e08-adf707c34cfe could not be found. Aug 06 14:40:49.827498 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:40:49.827498 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:40:49.827498 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:40:49.827498 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:40:49.827498 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:40:49.827498 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:40:49.827498 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 14:40:49.827498 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 14:40:49.827498 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d80056a-5ade-4f3b-8e08-adf707c34cfe could not be found. Aug 06 14:40:49.827498 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:40:49.829095 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-b7310e6d-f651-4110-99a0-087cd03fdae1 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Returning 404 to user: Instance 6d80056a-5ade-4f3b-8e08-adf707c34cfe could not be found. {{(pid=117838) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 14:40:49.829095 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-b7310e6d-f651-4110-99a0-087cd03fdae1 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/6d80056a-5ade-4f3b-8e08-adf707c34cfe" status: 404 len: 111 microversion: 2.1 time: 0.032550 Aug 06 14:40:49.829095 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 498/1044] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:40:49 2022] GET /compute/v2.1/servers/6d80056a-5ade-4f3b-8e08-adf707c34cfe => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 14:40:49.833020 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-5b0d6d57-fbbe-4dc6-aad7-4db318bb2571 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:40:49.833512 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-5b0d6d57-fbbe-4dc6-aad7-4db318bb2571 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 5a1c9667-a38f-471a-a735-b5dff6828a51] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:40:49.839376 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-5b0d6d57-fbbe-4dc6-aad7-4db318bb2571 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:49.839844 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-5b0d6d57-fbbe-4dc6-aad7-4db318bb2571 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:49.840270 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-5b0d6d57-fbbe-4dc6-aad7-4db318bb2571 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:49.841072 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-5b0d6d57-fbbe-4dc6-aad7-4db318bb2571 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:49.841607 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-5b0d6d57-fbbe-4dc6-aad7-4db318bb2571 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:49.842030 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-5b0d6d57-fbbe-4dc6-aad7-4db318bb2571 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:49.856080 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.wsgi [None req-5b0d6d57-fbbe-4dc6-aad7-4db318bb2571 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] HTTP exception thrown: Instance 5a1c9667-a38f-471a-a735-b5dff6828a51 could not be found. Aug 06 14:40:49.857623 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-5b0d6d57-fbbe-4dc6-aad7-4db318bb2571 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Request method failure captured: Aug 06 14:40:49.857623 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: request: DELETE /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51 HTTP/1.1 Aug 06 14:40:49.857623 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Accept: application/json Aug 06 14:40:49.857623 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Accept-Encoding: identity Aug 06 14:40:49.857623 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Connection: close Aug 06 14:40:49.857623 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Content-Length: 0 Aug 06 14:40:49.857623 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Content-Type: application/json Aug 06 14:40:49.857623 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Host: 10.222.0.17 Aug 06 14:40:49.857623 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Openstack-System-Scope: None Aug 06 14:40:49.857623 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: User-Agent: python-urllib3/1.26.11 Aug 06 14:40:49.857623 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Auth-Token: gAAAAABi7nrw1j_Ge2Ur2tEojXwBmjEDUihl-N8v1g20aSIVDaeL_OTgCZQS1IFihI0AmtEC1h-SgLRiudvycNkR7KjoTpqo7M5425d9Dy_4zXKbCfizwmIbraJL9PsVC3rQgInSWh6L4pF_pLJlUkvGCOVZ6ElDrY4gMQsJ7uwAoVwYy3EWJq0 Aug 06 14:40:49.857623 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Domain-Id: None Aug 06 14:40:49.857623 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Domain-Name: None Aug 06 14:40:49.857623 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Identity-Status: Confirmed Aug 06 14:40:49.857623 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Is-Admin-Project: True Aug 06 14:40:49.857623 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Domain-Id: default Aug 06 14:40:49.857623 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Domain-Name: Default Aug 06 14:40:49.857623 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Id: 96a7bb12d3ed4d1db2a58a03472483c2 Aug 06 14:40:49.857623 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Name: tempest-AttachVolumeNegativeTest-927490997 Aug 06 14:40:49.857623 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Role: member,reader Aug 06 14:40:49.857623 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Roles: member,reader Aug 06 14:40:49.859992 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/96a7bb12d3ed4d1db2a58a03472483c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/96a7bb12d3ed4d1db2a58a03472483c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_96a7bb12d3ed4d1db2a58a03472483c2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/96a7bb12d3ed4d1db2a58a03472483c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 06 14:40:49.859992 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant: tempest-AttachVolumeNegativeTest-927490997 Aug 06 14:40:49.859992 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant-Id: 96a7bb12d3ed4d1db2a58a03472483c2 Aug 06 14:40:49.859992 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-927490997 Aug 06 14:40:49.859992 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User: tempest-AttachVolumeNegativeTest-927490997-project Aug 06 14:40:49.859992 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Domain-Id: default Aug 06 14:40:49.859992 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Domain-Name: Default Aug 06 14:40:49.859992 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Id: 5378c85cd31c42dfbc39ce738a8b6dde Aug 06 14:40:49.859992 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Name: tempest-AttachVolumeNegativeTest-927490997-project Aug 06 14:40:49.859992 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: method: > Aug 06 14:40:49.859992 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: exception: Instance 5a1c9667-a38f-471a-a735-b5dff6828a51 could not be found. Aug 06 14:40:49.859992 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: action_args: {'id': '5a1c9667-a38f-471a-a735-b5dff6828a51'} Aug 06 14:40:49.861061 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 14:40:49.861061 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:40:49.861061 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 14:40:49.861061 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 14:40:49.861061 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 14:40:49.861061 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 14:40:49.861061 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 14:40:49.861061 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 14:40:49.861061 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 14:40:49.861061 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 14:40:49.861061 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a1c9667-a38f-471a-a735-b5dff6828a51 could not be found. Aug 06 14:40:49.861061 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:40:49.861061 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:40:49.861061 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:40:49.861061 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:40:49.861061 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:40:49.861061 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:40:49.861061 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 14:40:49.861061 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 14:40:49.861061 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 14:40:49.862517 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 14:40:49.862517 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 14:40:49.862517 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 14:40:49.862517 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 14:40:49.862517 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 14:40:49.862517 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 14:40:49.862517 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 14:40:49.862517 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 14:40:49.862517 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 14:40:49.862517 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a1c9667-a38f-471a-a735-b5dff6828a51 could not be found. Aug 06 14:40:49.862517 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:40:49.862517 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:40:49.862517 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:40:49.862517 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:40:49.862517 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:40:49.862517 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:40:49.862517 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 14:40:49.862517 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 14:40:49.862517 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a1c9667-a38f-471a-a735-b5dff6828a51 could not be found. Aug 06 14:40:49.862517 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:40:49.864354 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-5b0d6d57-fbbe-4dc6-aad7-4db318bb2571 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Returning 404 to user: Instance 5a1c9667-a38f-471a-a735-b5dff6828a51 could not be found. {{(pid=117837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 14:40:49.864354 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-5b0d6d57-fbbe-4dc6-aad7-4db318bb2571 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51" status: 404 len: 111 microversion: 2.1 time: 0.029713 Aug 06 14:40:49.864354 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 547/1045] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Aug 6 14:40:49 2022] DELETE /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 14:40:49.868800 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-96aa2821-e0e1-431b-8dde-bd168289f7e6 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:40:49.869416 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-96aa2821-e0e1-431b-8dde-bd168289f7e6 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 5a1c9667-a38f-471a-a735-b5dff6828a51] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:40:49.875306 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-96aa2821-e0e1-431b-8dde-bd168289f7e6 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:49.875788 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-96aa2821-e0e1-431b-8dde-bd168289f7e6 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:49.876221 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-96aa2821-e0e1-431b-8dde-bd168289f7e6 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:49.876904 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-96aa2821-e0e1-431b-8dde-bd168289f7e6 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:49.877357 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-96aa2821-e0e1-431b-8dde-bd168289f7e6 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:49.877780 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-96aa2821-e0e1-431b-8dde-bd168289f7e6 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:49.891040 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.wsgi [None req-96aa2821-e0e1-431b-8dde-bd168289f7e6 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] HTTP exception thrown: Instance 5a1c9667-a38f-471a-a735-b5dff6828a51 could not be found. Aug 06 14:40:49.892542 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-96aa2821-e0e1-431b-8dde-bd168289f7e6 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Request method failure captured: Aug 06 14:40:49.892542 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: request: GET /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51 HTTP/1.1 Aug 06 14:40:49.892542 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Accept: application/json Aug 06 14:40:49.892542 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Accept-Encoding: identity Aug 06 14:40:49.892542 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Connection: close Aug 06 14:40:49.892542 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Content-Length: 0 Aug 06 14:40:49.892542 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Content-Type: application/json Aug 06 14:40:49.892542 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Host: 10.222.0.17 Aug 06 14:40:49.892542 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Openstack-System-Scope: None Aug 06 14:40:49.892542 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: User-Agent: python-urllib3/1.26.11 Aug 06 14:40:49.892542 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Auth-Token: gAAAAABi7nrw1j_Ge2Ur2tEojXwBmjEDUihl-N8v1g20aSIVDaeL_OTgCZQS1IFihI0AmtEC1h-SgLRiudvycNkR7KjoTpqo7M5425d9Dy_4zXKbCfizwmIbraJL9PsVC3rQgInSWh6L4pF_pLJlUkvGCOVZ6ElDrY4gMQsJ7uwAoVwYy3EWJq0 Aug 06 14:40:49.892542 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Domain-Id: None Aug 06 14:40:49.892542 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Domain-Name: None Aug 06 14:40:49.892542 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Identity-Status: Confirmed Aug 06 14:40:49.892542 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Is-Admin-Project: True Aug 06 14:40:49.892542 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Domain-Id: default Aug 06 14:40:49.892542 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Domain-Name: Default Aug 06 14:40:49.892542 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Id: 96a7bb12d3ed4d1db2a58a03472483c2 Aug 06 14:40:49.892542 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Name: tempest-AttachVolumeNegativeTest-927490997 Aug 06 14:40:49.892542 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Role: member,reader Aug 06 14:40:49.892542 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Roles: member,reader Aug 06 14:40:49.894084 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/96a7bb12d3ed4d1db2a58a03472483c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/96a7bb12d3ed4d1db2a58a03472483c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_96a7bb12d3ed4d1db2a58a03472483c2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/96a7bb12d3ed4d1db2a58a03472483c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 06 14:40:49.894084 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Tenant: tempest-AttachVolumeNegativeTest-927490997 Aug 06 14:40:49.894084 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Tenant-Id: 96a7bb12d3ed4d1db2a58a03472483c2 Aug 06 14:40:49.894084 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-927490997 Aug 06 14:40:49.894084 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User: tempest-AttachVolumeNegativeTest-927490997-project Aug 06 14:40:49.894084 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Domain-Id: default Aug 06 14:40:49.894084 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Domain-Name: Default Aug 06 14:40:49.894084 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Id: 5378c85cd31c42dfbc39ce738a8b6dde Aug 06 14:40:49.894084 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Name: tempest-AttachVolumeNegativeTest-927490997-project Aug 06 14:40:49.894084 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: method: > Aug 06 14:40:49.894084 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: exception: Instance 5a1c9667-a38f-471a-a735-b5dff6828a51 could not be found. Aug 06 14:40:49.894084 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: action_args: {'id': '5a1c9667-a38f-471a-a735-b5dff6828a51'} Aug 06 14:40:49.895168 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 14:40:49.895168 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:40:49.895168 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 14:40:49.895168 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 14:40:49.895168 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 14:40:49.895168 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 14:40:49.895168 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 14:40:49.895168 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 14:40:49.895168 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 14:40:49.895168 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 14:40:49.895168 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a1c9667-a38f-471a-a735-b5dff6828a51 could not be found. Aug 06 14:40:49.895168 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:40:49.895168 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:40:49.895168 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:40:49.895168 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:40:49.895168 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:40:49.895168 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:40:49.895168 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 14:40:49.895168 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 14:40:49.895168 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 14:40:49.896655 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 14:40:49.896655 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 14:40:49.896655 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 14:40:49.896655 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 14:40:49.896655 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 14:40:49.896655 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 14:40:49.896655 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 14:40:49.896655 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a1c9667-a38f-471a-a735-b5dff6828a51 could not be found. Aug 06 14:40:49.896655 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:40:49.896655 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:40:49.896655 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:40:49.896655 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:40:49.896655 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:40:49.896655 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:40:49.896655 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 14:40:49.896655 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 14:40:49.896655 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a1c9667-a38f-471a-a735-b5dff6828a51 could not be found. Aug 06 14:40:49.896655 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:40:49.898054 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-96aa2821-e0e1-431b-8dde-bd168289f7e6 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Returning 404 to user: Instance 5a1c9667-a38f-471a-a735-b5dff6828a51 could not be found. {{(pid=117838) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 14:40:49.898054 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-96aa2821-e0e1-431b-8dde-bd168289f7e6 tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51" status: 404 len: 111 microversion: 2.1 time: 0.029082 Aug 06 14:40:49.898054 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 499/1046] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:40:49 2022] GET /compute/v2.1/servers/5a1c9667-a38f-471a-a735-b5dff6828a51 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 14:40:54.181189 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-604b24fe-dc32-4182-b18f-1b4c06e303aa tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:40:54.181681 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-604b24fe-dc32-4182-b18f-1b4c06e303aa tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6e717f01-c854-444e-9872-51e2c1c78987] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:40:54.188515 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-604b24fe-dc32-4182-b18f-1b4c06e303aa tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:54.188966 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-604b24fe-dc32-4182-b18f-1b4c06e303aa tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:54.189392 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-604b24fe-dc32-4182-b18f-1b4c06e303aa tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:54.190201 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-604b24fe-dc32-4182-b18f-1b4c06e303aa tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:54.190655 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-604b24fe-dc32-4182-b18f-1b4c06e303aa tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:54.191098 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-604b24fe-dc32-4182-b18f-1b4c06e303aa tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:54.204174 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.wsgi [None req-604b24fe-dc32-4182-b18f-1b4c06e303aa tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] HTTP exception thrown: Instance 6e717f01-c854-444e-9872-51e2c1c78987 could not be found. Aug 06 14:40:54.205695 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-604b24fe-dc32-4182-b18f-1b4c06e303aa tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Request method failure captured: Aug 06 14:40:54.205695 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: request: DELETE /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987 HTTP/1.1 Aug 06 14:40:54.205695 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Accept: application/json Aug 06 14:40:54.205695 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Accept-Encoding: identity Aug 06 14:40:54.205695 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Connection: close Aug 06 14:40:54.205695 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Content-Length: 0 Aug 06 14:40:54.205695 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Content-Type: application/json Aug 06 14:40:54.205695 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Host: 10.222.0.17 Aug 06 14:40:54.205695 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Openstack-System-Scope: None Aug 06 14:40:54.205695 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: User-Agent: python-urllib3/1.26.11 Aug 06 14:40:54.205695 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Auth-Token: gAAAAABi7nrw1j_Ge2Ur2tEojXwBmjEDUihl-N8v1g20aSIVDaeL_OTgCZQS1IFihI0AmtEC1h-SgLRiudvycNkR7KjoTpqo7M5425d9Dy_4zXKbCfizwmIbraJL9PsVC3rQgInSWh6L4pF_pLJlUkvGCOVZ6ElDrY4gMQsJ7uwAoVwYy3EWJq0 Aug 06 14:40:54.205695 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Domain-Id: None Aug 06 14:40:54.205695 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Domain-Name: None Aug 06 14:40:54.205695 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Identity-Status: Confirmed Aug 06 14:40:54.205695 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Is-Admin-Project: True Aug 06 14:40:54.205695 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Domain-Id: default Aug 06 14:40:54.205695 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Domain-Name: Default Aug 06 14:40:54.205695 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Id: 96a7bb12d3ed4d1db2a58a03472483c2 Aug 06 14:40:54.205695 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Name: tempest-AttachVolumeNegativeTest-927490997 Aug 06 14:40:54.205695 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Role: member,reader Aug 06 14:40:54.205695 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Roles: member,reader Aug 06 14:40:54.207227 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/96a7bb12d3ed4d1db2a58a03472483c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/96a7bb12d3ed4d1db2a58a03472483c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_96a7bb12d3ed4d1db2a58a03472483c2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/96a7bb12d3ed4d1db2a58a03472483c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 06 14:40:54.207227 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant: tempest-AttachVolumeNegativeTest-927490997 Aug 06 14:40:54.207227 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant-Id: 96a7bb12d3ed4d1db2a58a03472483c2 Aug 06 14:40:54.207227 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-927490997 Aug 06 14:40:54.207227 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User: tempest-AttachVolumeNegativeTest-927490997-project Aug 06 14:40:54.207227 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Domain-Id: default Aug 06 14:40:54.207227 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Domain-Name: Default Aug 06 14:40:54.207227 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Id: 5378c85cd31c42dfbc39ce738a8b6dde Aug 06 14:40:54.207227 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Name: tempest-AttachVolumeNegativeTest-927490997-project Aug 06 14:40:54.207227 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: method: > Aug 06 14:40:54.207227 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: exception: Instance 6e717f01-c854-444e-9872-51e2c1c78987 could not be found. Aug 06 14:40:54.207227 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: action_args: {'id': '6e717f01-c854-444e-9872-51e2c1c78987'} Aug 06 14:40:54.207960 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 14:40:54.207960 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:40:54.207960 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 14:40:54.207960 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 14:40:54.207960 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 14:40:54.207960 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 14:40:54.207960 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 14:40:54.207960 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 14:40:54.207960 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 14:40:54.207960 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 14:40:54.207960 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e717f01-c854-444e-9872-51e2c1c78987 could not be found. Aug 06 14:40:54.207960 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:40:54.207960 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:40:54.207960 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:40:54.207960 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:40:54.207960 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:40:54.207960 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:40:54.207960 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 14:40:54.207960 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 14:40:54.207960 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 14:40:54.209148 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 14:40:54.209148 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 14:40:54.209148 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 14:40:54.209148 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 14:40:54.209148 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 14:40:54.209148 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 14:40:54.209148 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 14:40:54.209148 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 14:40:54.209148 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 14:40:54.209148 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e717f01-c854-444e-9872-51e2c1c78987 could not be found. Aug 06 14:40:54.209148 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:40:54.209148 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:40:54.209148 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:40:54.209148 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:40:54.209148 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:40:54.209148 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:40:54.209148 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 14:40:54.209148 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 14:40:54.209148 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e717f01-c854-444e-9872-51e2c1c78987 could not be found. Aug 06 14:40:54.209148 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:40:54.210347 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-604b24fe-dc32-4182-b18f-1b4c06e303aa tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Returning 404 to user: Instance 6e717f01-c854-444e-9872-51e2c1c78987 could not be found. {{(pid=117837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 14:40:54.210347 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-604b24fe-dc32-4182-b18f-1b4c06e303aa tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "DELETE /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987" status: 404 len: 111 microversion: 2.1 time: 0.029672 Aug 06 14:40:54.210347 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 548/1047] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Aug 6 14:40:54 2022] DELETE /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 14:40:54.215483 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-2d5960bf-df3f-460c-ab25-1ebce0ba5b4b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:40:54.216102 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-2d5960bf-df3f-460c-ab25-1ebce0ba5b4b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] [instance: 6e717f01-c854-444e-9872-51e2c1c78987] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:40:54.223077 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2d5960bf-df3f-460c-ab25-1ebce0ba5b4b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:54.223556 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2d5960bf-df3f-460c-ab25-1ebce0ba5b4b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:54.223992 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2d5960bf-df3f-460c-ab25-1ebce0ba5b4b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:54.224674 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2d5960bf-df3f-460c-ab25-1ebce0ba5b4b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:54.225124 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2d5960bf-df3f-460c-ab25-1ebce0ba5b4b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:54.225547 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2d5960bf-df3f-460c-ab25-1ebce0ba5b4b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:54.239302 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.wsgi [None req-2d5960bf-df3f-460c-ab25-1ebce0ba5b4b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] HTTP exception thrown: Instance 6e717f01-c854-444e-9872-51e2c1c78987 could not be found. Aug 06 14:40:54.240800 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-2d5960bf-df3f-460c-ab25-1ebce0ba5b4b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Request method failure captured: Aug 06 14:40:54.240800 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: request: GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987 HTTP/1.1 Aug 06 14:40:54.240800 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Accept: application/json Aug 06 14:40:54.240800 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Accept-Encoding: identity Aug 06 14:40:54.240800 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Connection: close Aug 06 14:40:54.240800 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Content-Length: 0 Aug 06 14:40:54.240800 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Content-Type: application/json Aug 06 14:40:54.240800 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Host: 10.222.0.17 Aug 06 14:40:54.240800 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Openstack-System-Scope: None Aug 06 14:40:54.240800 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: User-Agent: python-urllib3/1.26.11 Aug 06 14:40:54.240800 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Auth-Token: gAAAAABi7nrw1j_Ge2Ur2tEojXwBmjEDUihl-N8v1g20aSIVDaeL_OTgCZQS1IFihI0AmtEC1h-SgLRiudvycNkR7KjoTpqo7M5425d9Dy_4zXKbCfizwmIbraJL9PsVC3rQgInSWh6L4pF_pLJlUkvGCOVZ6ElDrY4gMQsJ7uwAoVwYy3EWJq0 Aug 06 14:40:54.240800 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Domain-Id: None Aug 06 14:40:54.240800 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Domain-Name: None Aug 06 14:40:54.240800 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Identity-Status: Confirmed Aug 06 14:40:54.240800 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Is-Admin-Project: True Aug 06 14:40:54.240800 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Domain-Id: default Aug 06 14:40:54.240800 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Domain-Name: Default Aug 06 14:40:54.240800 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Id: 96a7bb12d3ed4d1db2a58a03472483c2 Aug 06 14:40:54.240800 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Name: tempest-AttachVolumeNegativeTest-927490997 Aug 06 14:40:54.240800 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Role: member,reader Aug 06 14:40:54.240800 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Roles: member,reader Aug 06 14:40:54.242423 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/96a7bb12d3ed4d1db2a58a03472483c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/96a7bb12d3ed4d1db2a58a03472483c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_96a7bb12d3ed4d1db2a58a03472483c2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/96a7bb12d3ed4d1db2a58a03472483c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 06 14:40:54.242423 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Tenant: tempest-AttachVolumeNegativeTest-927490997 Aug 06 14:40:54.242423 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Tenant-Id: 96a7bb12d3ed4d1db2a58a03472483c2 Aug 06 14:40:54.242423 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-927490997 Aug 06 14:40:54.242423 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User: tempest-AttachVolumeNegativeTest-927490997-project Aug 06 14:40:54.242423 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Domain-Id: default Aug 06 14:40:54.242423 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Domain-Name: Default Aug 06 14:40:54.242423 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Id: 5378c85cd31c42dfbc39ce738a8b6dde Aug 06 14:40:54.242423 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Name: tempest-AttachVolumeNegativeTest-927490997-project Aug 06 14:40:54.242423 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: method: > Aug 06 14:40:54.242423 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: exception: Instance 6e717f01-c854-444e-9872-51e2c1c78987 could not be found. Aug 06 14:40:54.242423 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: action_args: {'id': '6e717f01-c854-444e-9872-51e2c1c78987'} Aug 06 14:40:54.243459 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 14:40:54.243459 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:40:54.243459 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 14:40:54.243459 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 14:40:54.243459 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 14:40:54.243459 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 14:40:54.243459 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 14:40:54.243459 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 14:40:54.243459 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 14:40:54.243459 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 14:40:54.243459 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e717f01-c854-444e-9872-51e2c1c78987 could not be found. Aug 06 14:40:54.243459 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:40:54.243459 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:40:54.243459 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:40:54.243459 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:40:54.243459 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:40:54.243459 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:40:54.243459 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 14:40:54.243459 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 14:40:54.243459 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 14:40:54.244920 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 14:40:54.244920 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 14:40:54.244920 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 14:40:54.244920 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 14:40:54.244920 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 14:40:54.244920 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 14:40:54.244920 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 14:40:54.244920 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e717f01-c854-444e-9872-51e2c1c78987 could not be found. Aug 06 14:40:54.244920 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:40:54.244920 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:40:54.244920 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:40:54.244920 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:40:54.244920 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:40:54.244920 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:40:54.244920 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 14:40:54.244920 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 14:40:54.244920 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e717f01-c854-444e-9872-51e2c1c78987 could not be found. Aug 06 14:40:54.244920 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:40:54.246263 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-2d5960bf-df3f-460c-ab25-1ebce0ba5b4b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] Returning 404 to user: Instance 6e717f01-c854-444e-9872-51e2c1c78987 could not be found. {{(pid=117838) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 14:40:54.246263 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-2d5960bf-df3f-460c-ab25-1ebce0ba5b4b tempest-AttachVolumeNegativeTest-927490997 tempest-AttachVolumeNegativeTest-927490997-project] 10.222.0.17 "GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987" status: 404 len: 111 microversion: 2.1 time: 0.030536 Aug 06 14:40:54.246263 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 500/1048] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:40:54 2022] GET /compute/v2.1/servers/6e717f01-c854-444e-9872-51e2c1c78987 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 14:40:58.006339 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-e0acf015-1cdc-46fe-9511-6b854aaa1418 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:40:58.008555 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-e0acf015-1cdc-46fe-9511-6b854aaa1418 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:40:58.014758 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e0acf015-1cdc-46fe-9511-6b854aaa1418 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:58.015270 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e0acf015-1cdc-46fe-9511-6b854aaa1418 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:58.015713 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e0acf015-1cdc-46fe-9511-6b854aaa1418 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:58.016399 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e0acf015-1cdc-46fe-9511-6b854aaa1418 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:58.019433 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e0acf015-1cdc-46fe-9511-6b854aaa1418 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:58.019889 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e0acf015-1cdc-46fe-9511-6b854aaa1418 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:58.050924 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-e0acf015-1cdc-46fe-9511-6b854aaa1418 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048499 Aug 06 14:40:58.051474 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 549/1049] 10.222.0.17 () {60 vars in 1343 bytes} [Sat Aug 6 14:40:58 2022] GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:40:58.116403 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-f7f3549c-e678-431c-9ab2-65d1d6d233c4 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:40:58.116981 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-f7f3549c-e678-431c-9ab2-65d1d6d233c4 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:40:58.126695 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f7f3549c-e678-431c-9ab2-65d1d6d233c4 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:58.126695 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f7f3549c-e678-431c-9ab2-65d1d6d233c4 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:58.126695 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f7f3549c-e678-431c-9ab2-65d1d6d233c4 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:58.126695 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f7f3549c-e678-431c-9ab2-65d1d6d233c4 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:58.127110 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f7f3549c-e678-431c-9ab2-65d1d6d233c4 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:58.127110 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f7f3549c-e678-431c-9ab2-65d1d6d233c4 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:58.151246 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-f7f3549c-e678-431c-9ab2-65d1d6d233c4 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Going to try to terminate instance {{(pid=117838) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 14:40:58.252519 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-f7f3549c-e678-431c-9ab2-65d1d6d233c4 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "DELETE /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e" status: 204 len: 0 microversion: 2.20 time: 0.139158 Aug 06 14:40:58.255091 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 501/1050] 10.222.0.17 () {60 vars in 1280 bytes} [Sat Aug 6 14:40:58 2022] DELETE /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 06 14:40:58.263312 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-e43b373d-0c5c-48f5-a5d1-b84d8d1abe04 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:40:58.264380 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-e43b373d-0c5c-48f5-a5d1-b84d8d1abe04 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:40:58.271957 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e43b373d-0c5c-48f5-a5d1-b84d8d1abe04 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:58.272444 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e43b373d-0c5c-48f5-a5d1-b84d8d1abe04 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:58.272873 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e43b373d-0c5c-48f5-a5d1-b84d8d1abe04 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:58.273569 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e43b373d-0c5c-48f5-a5d1-b84d8d1abe04 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:58.274056 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e43b373d-0c5c-48f5-a5d1-b84d8d1abe04 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:58.274474 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e43b373d-0c5c-48f5-a5d1-b84d8d1abe04 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:58.418350 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-e43b373d-0c5c-48f5-a5d1-b84d8d1abe04 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:40:58.428273 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-e43b373d-0c5c-48f5-a5d1-b84d8d1abe04 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:40:58.429819 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-e43b373d-0c5c-48f5-a5d1-b84d8d1abe04 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:40:58.431060 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-e43b373d-0c5c-48f5-a5d1-b84d8d1abe04 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e" status: 200 len: 1725 microversion: 2.20 time: 0.171841 Aug 06 14:40:58.431595 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 550/1051] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:40:58 2022] GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:40:59.456600 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-063eae01-9906-4a68-a5f9-63d3329cf250 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:40:59.457478 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-063eae01-9906-4a68-a5f9-63d3329cf250 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:40:59.464274 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-063eae01-9906-4a68-a5f9-63d3329cf250 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:59.464760 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-063eae01-9906-4a68-a5f9-63d3329cf250 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:59.465226 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-063eae01-9906-4a68-a5f9-63d3329cf250 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:59.465926 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-063eae01-9906-4a68-a5f9-63d3329cf250 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:40:59.466382 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-063eae01-9906-4a68-a5f9-63d3329cf250 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:40:59.467125 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-063eae01-9906-4a68-a5f9-63d3329cf250 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:40:59.604791 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-063eae01-9906-4a68-a5f9-63d3329cf250 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:40:59.614042 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-063eae01-9906-4a68-a5f9-63d3329cf250 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:40:59.615605 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-063eae01-9906-4a68-a5f9-63d3329cf250 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:40:59.616764 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-063eae01-9906-4a68-a5f9-63d3329cf250 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e" status: 200 len: 1725 microversion: 2.20 time: 0.165315 Aug 06 14:40:59.617310 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 502/1052] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:40:59 2022] GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:41:00.642371 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-d86d9e4d-5e02-48a7-b768-1044d1da5043 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:41:00.642371 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-d86d9e4d-5e02-48a7-b768-1044d1da5043 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:41:00.648048 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d86d9e4d-5e02-48a7-b768-1044d1da5043 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:41:00.648636 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d86d9e4d-5e02-48a7-b768-1044d1da5043 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:41:00.649171 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d86d9e4d-5e02-48a7-b768-1044d1da5043 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:41:00.649956 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d86d9e4d-5e02-48a7-b768-1044d1da5043 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:41:00.650508 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d86d9e4d-5e02-48a7-b768-1044d1da5043 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:41:00.651061 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d86d9e4d-5e02-48a7-b768-1044d1da5043 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:41:00.898807 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-d86d9e4d-5e02-48a7-b768-1044d1da5043 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:41:00.907534 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-d86d9e4d-5e02-48a7-b768-1044d1da5043 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:41:00.909101 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-d86d9e4d-5e02-48a7-b768-1044d1da5043 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be34f77da4d8407e9a4333bc71f64595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f20dc7bdc3a4448a56a76f1efbec596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:41:00.910391 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-d86d9e4d-5e02-48a7-b768-1044d1da5043 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e" status: 200 len: 1725 microversion: 2.20 time: 0.274303 Aug 06 14:41:00.911300 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 551/1053] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:41:00 2022] GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e => generated 1725 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 06 14:41:01.339848 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [req-bc767f2c-5a49-4fa1-b1d8-52bdcaadf11d req-372363eb-6676-4832-9cfc-6558236e1a4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91e50552-3108-4fca-82ca-e299af40061e", "name": "network-vif-deleted", "tag": "d910f3cd-711d-43f7-8b9c-b79ca1e620bd"}]} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:41:01.350776 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-bc767f2c-5a49-4fa1-b1d8-52bdcaadf11d req-372363eb-6676-4832-9cfc-6558236e1a4e service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:41:01.351298 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-bc767f2c-5a49-4fa1-b1d8-52bdcaadf11d req-372363eb-6676-4832-9cfc-6558236e1a4e service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:41:01.352508 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-bc767f2c-5a49-4fa1-b1d8-52bdcaadf11d req-372363eb-6676-4832-9cfc-6558236e1a4e service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:41:01.376133 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.compute.server_external_events [req-bc767f2c-5a49-4fa1-b1d8-52bdcaadf11d req-372363eb-6676-4832-9cfc-6558236e1a4e service nova] Creating event network-vif-deleted:d910f3cd-711d-43f7-8b9c-b79ca1e620bd for instance 91e50552-3108-4fca-82ca-e299af40061e on hv-cinder-85199 Aug 06 14:41:01.385375 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [req-bc767f2c-5a49-4fa1-b1d8-52bdcaadf11d req-372363eb-6676-4832-9cfc-6558236e1a4e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049207 Aug 06 14:41:01.386072 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 503/1054] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:41:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:41:01.940777 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-2c468763-8ffb-4815-8320-7bb12e38562a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:41:01.943552 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-2c468763-8ffb-4815-8320-7bb12e38562a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:41:01.956649 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2c468763-8ffb-4815-8320-7bb12e38562a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:41:01.957259 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2c468763-8ffb-4815-8320-7bb12e38562a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:41:01.957839 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2c468763-8ffb-4815-8320-7bb12e38562a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:41:01.958812 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2c468763-8ffb-4815-8320-7bb12e38562a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:41:01.959563 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2c468763-8ffb-4815-8320-7bb12e38562a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:41:01.959989 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2c468763-8ffb-4815-8320-7bb12e38562a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:41:01.983785 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.wsgi [None req-2c468763-8ffb-4815-8320-7bb12e38562a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] HTTP exception thrown: Instance 91e50552-3108-4fca-82ca-e299af40061e could not be found. Aug 06 14:41:01.986087 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-2c468763-8ffb-4815-8320-7bb12e38562a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Request method failure captured: Aug 06 14:41:01.986087 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: request: GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e HTTP/1.1 Aug 06 14:41:01.986087 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Accept: application/json Aug 06 14:41:01.986087 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Accept-Encoding: identity Aug 06 14:41:01.986087 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Connection: close Aug 06 14:41:01.986087 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Content-Length: 0 Aug 06 14:41:01.986087 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Content-Type: application/json Aug 06 14:41:01.986087 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Host: 10.222.0.17 Aug 06 14:41:01.986087 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Openstack-System-Scope: None Aug 06 14:41:01.986087 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: User-Agent: python-urllib3/1.26.11 Aug 06 14:41:01.986087 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Auth-Token: gAAAAABi7nrq6tL7qiEJGlB3Mk3s36rji_pwLVPV4k0GgsWA99mXI_y6g9OvbW0iTkcSI4eVLu8m4Uu6E06JohWe_gts8lqm_nQN_ZSYF4Wq4WDw9ivys9iDdeMKPqbYBg05mVkiTi8aRdnZ5sTNWZ_8t6O0DccYDCKnIxAGxbXKyLNLWp6EiMQ Aug 06 14:41:01.986087 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Domain-Id: None Aug 06 14:41:01.986087 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Domain-Name: None Aug 06 14:41:01.986087 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Identity-Status: Confirmed Aug 06 14:41:01.986087 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Is-Admin-Project: True Aug 06 14:41:01.986087 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Openstack-Nova-Api-Version: 2.20 Aug 06 14:41:01.986087 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Domain-Id: default Aug 06 14:41:01.986087 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Domain-Name: Default Aug 06 14:41:01.986087 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Id: 2f20dc7bdc3a4448a56a76f1efbec596 Aug 06 14:41:01.986087 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-536291305 Aug 06 14:41:01.986087 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Role: member,reader Aug 06 14:41:01.986087 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Roles: member,reader Aug 06 14:41:01.988181 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2f20dc7bdc3a4448a56a76f1efbec596"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2f20dc7bdc3a4448a56a76f1efbec596"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2f20dc7bdc3a4448a56a76f1efbec596", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2f20dc7bdc3a4448a56a76f1efbec596"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 06 14:41:01.988181 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant: tempest-AttachVolumeShelveTestJSON-536291305 Aug 06 14:41:01.988181 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant-Id: 2f20dc7bdc3a4448a56a76f1efbec596 Aug 06 14:41:01.988181 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-536291305 Aug 06 14:41:01.988181 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User: tempest-AttachVolumeShelveTestJSON-536291305-project Aug 06 14:41:01.988181 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Domain-Id: default Aug 06 14:41:01.988181 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Domain-Name: Default Aug 06 14:41:01.988181 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Id: be34f77da4d8407e9a4333bc71f64595 Aug 06 14:41:01.988181 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Name: tempest-AttachVolumeShelveTestJSON-536291305-project Aug 06 14:41:01.988181 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: method: > Aug 06 14:41:01.988181 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: exception: Instance 91e50552-3108-4fca-82ca-e299af40061e could not be found. Aug 06 14:41:01.988181 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: action_args: {'id': '91e50552-3108-4fca-82ca-e299af40061e'} Aug 06 14:41:01.989209 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 14:41:01.989209 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:41:01.989209 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 14:41:01.989209 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 14:41:01.989209 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 14:41:01.989209 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 14:41:01.989209 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 14:41:01.989209 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 14:41:01.989209 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 14:41:01.989209 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 14:41:01.989209 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91e50552-3108-4fca-82ca-e299af40061e could not be found. Aug 06 14:41:01.989209 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:41:01.989209 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:41:01.989209 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:41:01.989209 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:41:01.989209 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:41:01.989209 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:41:01.989209 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 14:41:01.989209 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 14:41:01.989209 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 14:41:01.990746 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 14:41:01.990746 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 14:41:01.990746 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 14:41:01.990746 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 14:41:01.990746 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 14:41:01.990746 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 14:41:01.990746 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 14:41:01.990746 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91e50552-3108-4fca-82ca-e299af40061e could not be found. Aug 06 14:41:01.990746 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:41:01.990746 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:41:01.990746 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:41:01.990746 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:41:01.990746 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:41:01.990746 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:41:01.990746 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 14:41:01.990746 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 14:41:01.990746 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91e50552-3108-4fca-82ca-e299af40061e could not be found. Aug 06 14:41:01.990746 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:41:01.992634 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-2c468763-8ffb-4815-8320-7bb12e38562a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Returning 404 to user: Instance 91e50552-3108-4fca-82ca-e299af40061e could not be found. {{(pid=117837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 14:41:01.992634 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-2c468763-8ffb-4815-8320-7bb12e38562a tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e" status: 404 len: 111 microversion: 2.20 time: 0.055550 Aug 06 14:41:01.999235 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-114b7782-ee87-4683-8849-ae8b76073f57 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '.version_select at 0x7fbab165cee0>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:41:02.003266 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 552/1055] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:41:01 2022] GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 06 14:41:02.035596 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-114b7782-ee87-4683-8849-ae8b76073f57 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2025997875" status: 204 len: 0 microversion: 2.20 time: 0.040836 Aug 06 14:41:02.036278 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 504/1056] 10.222.0.17 () {60 vars in 1262 bytes} [Sat Aug 6 14:41:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2025997875 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 06 14:41:03.993814 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-10fa00e8-4b72-40a9-8928-7978507cb563 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:41:03.994317 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-10fa00e8-4b72-40a9-8928-7978507cb563 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:41:03.996676 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:41:04.002201 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-10fa00e8-4b72-40a9-8928-7978507cb563 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:41:04.002679 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-10fa00e8-4b72-40a9-8928-7978507cb563 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:41:04.003136 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-10fa00e8-4b72-40a9-8928-7978507cb563 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:41:04.003817 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-10fa00e8-4b72-40a9-8928-7978507cb563 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:41:04.004262 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-10fa00e8-4b72-40a9-8928-7978507cb563 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:41:04.004678 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-10fa00e8-4b72-40a9-8928-7978507cb563 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:41:04.009507 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:41:04.020331 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.wsgi [None req-10fa00e8-4b72-40a9-8928-7978507cb563 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] HTTP exception thrown: Instance 91e50552-3108-4fca-82ca-e299af40061e could not be found. Aug 06 14:41:04.021847 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-10fa00e8-4b72-40a9-8928-7978507cb563 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Request method failure captured: Aug 06 14:41:04.021847 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: request: DELETE /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e HTTP/1.1 Aug 06 14:41:04.021847 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Accept: application/json Aug 06 14:41:04.021847 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Accept-Encoding: identity Aug 06 14:41:04.021847 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Connection: close Aug 06 14:41:04.021847 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Content-Length: 0 Aug 06 14:41:04.021847 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Content-Type: application/json Aug 06 14:41:04.021847 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Host: 10.222.0.17 Aug 06 14:41:04.021847 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Openstack-System-Scope: None Aug 06 14:41:04.021847 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: User-Agent: python-urllib3/1.26.11 Aug 06 14:41:04.021847 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Auth-Token: gAAAAABi7nrq6tL7qiEJGlB3Mk3s36rji_pwLVPV4k0GgsWA99mXI_y6g9OvbW0iTkcSI4eVLu8m4Uu6E06JohWe_gts8lqm_nQN_ZSYF4Wq4WDw9ivys9iDdeMKPqbYBg05mVkiTi8aRdnZ5sTNWZ_8t6O0DccYDCKnIxAGxbXKyLNLWp6EiMQ Aug 06 14:41:04.021847 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Domain-Id: None Aug 06 14:41:04.021847 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Domain-Name: None Aug 06 14:41:04.021847 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Identity-Status: Confirmed Aug 06 14:41:04.021847 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Is-Admin-Project: True Aug 06 14:41:04.021847 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Openstack-Nova-Api-Version: 2.20 Aug 06 14:41:04.021847 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Domain-Id: default Aug 06 14:41:04.021847 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Domain-Name: Default Aug 06 14:41:04.021847 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Id: 2f20dc7bdc3a4448a56a76f1efbec596 Aug 06 14:41:04.021847 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-536291305 Aug 06 14:41:04.021847 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Role: member,reader Aug 06 14:41:04.021847 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Roles: member,reader Aug 06 14:41:04.023539 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2f20dc7bdc3a4448a56a76f1efbec596"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2f20dc7bdc3a4448a56a76f1efbec596"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2f20dc7bdc3a4448a56a76f1efbec596", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2f20dc7bdc3a4448a56a76f1efbec596"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 06 14:41:04.023539 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant: tempest-AttachVolumeShelveTestJSON-536291305 Aug 06 14:41:04.023539 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant-Id: 2f20dc7bdc3a4448a56a76f1efbec596 Aug 06 14:41:04.023539 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-536291305 Aug 06 14:41:04.023539 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User: tempest-AttachVolumeShelveTestJSON-536291305-project Aug 06 14:41:04.023539 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Domain-Id: default Aug 06 14:41:04.023539 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Domain-Name: Default Aug 06 14:41:04.023539 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Id: be34f77da4d8407e9a4333bc71f64595 Aug 06 14:41:04.023539 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Name: tempest-AttachVolumeShelveTestJSON-536291305-project Aug 06 14:41:04.023539 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: method: > Aug 06 14:41:04.023539 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: exception: Instance 91e50552-3108-4fca-82ca-e299af40061e could not be found. Aug 06 14:41:04.023539 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: action_args: {'id': '91e50552-3108-4fca-82ca-e299af40061e'} Aug 06 14:41:04.024547 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 14:41:04.024547 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:41:04.024547 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 14:41:04.024547 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 14:41:04.024547 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 14:41:04.024547 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 14:41:04.024547 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 14:41:04.024547 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 14:41:04.024547 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 14:41:04.024547 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 14:41:04.024547 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91e50552-3108-4fca-82ca-e299af40061e could not be found. Aug 06 14:41:04.024547 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:41:04.024547 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:41:04.024547 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:41:04.024547 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:41:04.024547 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:41:04.024547 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:41:04.024547 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 14:41:04.024547 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 14:41:04.024547 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 14:41:04.025835 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 14:41:04.025835 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 14:41:04.025835 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 14:41:04.025835 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 14:41:04.025835 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 14:41:04.025835 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 14:41:04.025835 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 14:41:04.025835 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 14:41:04.025835 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 14:41:04.025835 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91e50552-3108-4fca-82ca-e299af40061e could not be found. Aug 06 14:41:04.025835 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:41:04.025835 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:41:04.025835 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:41:04.025835 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:41:04.025835 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:41:04.025835 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:41:04.025835 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 14:41:04.025835 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 14:41:04.025835 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91e50552-3108-4fca-82ca-e299af40061e could not be found. Aug 06 14:41:04.025835 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:41:04.027599 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-10fa00e8-4b72-40a9-8928-7978507cb563 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Returning 404 to user: Instance 91e50552-3108-4fca-82ca-e299af40061e could not be found. {{(pid=117837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 14:41:04.027599 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-10fa00e8-4b72-40a9-8928-7978507cb563 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "DELETE /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e" status: 404 len: 111 microversion: 2.20 time: 0.033257 Aug 06 14:41:04.027599 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 553/1057] 10.222.0.17 () {60 vars in 1280 bytes} [Sat Aug 6 14:41:03 2022] DELETE /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 06 14:41:04.031884 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-bd0d4c0d-2ec5-44ce-92b3-833956591bae tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:41:04.032609 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-bd0d4c0d-2ec5-44ce-92b3-833956591bae tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 91e50552-3108-4fca-82ca-e299af40061e] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:41:04.039648 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-bd0d4c0d-2ec5-44ce-92b3-833956591bae tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:41:04.040125 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-bd0d4c0d-2ec5-44ce-92b3-833956591bae tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:41:04.040562 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-bd0d4c0d-2ec5-44ce-92b3-833956591bae tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:41:04.041258 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-bd0d4c0d-2ec5-44ce-92b3-833956591bae tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:41:04.041713 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-bd0d4c0d-2ec5-44ce-92b3-833956591bae tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:41:04.042164 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-bd0d4c0d-2ec5-44ce-92b3-833956591bae tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:41:04.056833 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.wsgi [None req-bd0d4c0d-2ec5-44ce-92b3-833956591bae tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] HTTP exception thrown: Instance 91e50552-3108-4fca-82ca-e299af40061e could not be found. Aug 06 14:41:04.058782 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-bd0d4c0d-2ec5-44ce-92b3-833956591bae tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Request method failure captured: Aug 06 14:41:04.058782 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: request: GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e HTTP/1.1 Aug 06 14:41:04.058782 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Accept: application/json Aug 06 14:41:04.058782 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Accept-Encoding: identity Aug 06 14:41:04.058782 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Connection: close Aug 06 14:41:04.058782 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Content-Length: 0 Aug 06 14:41:04.058782 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Content-Type: application/json Aug 06 14:41:04.058782 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Host: 10.222.0.17 Aug 06 14:41:04.058782 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Openstack-System-Scope: None Aug 06 14:41:04.058782 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: User-Agent: python-urllib3/1.26.11 Aug 06 14:41:04.058782 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Auth-Token: gAAAAABi7nrq6tL7qiEJGlB3Mk3s36rji_pwLVPV4k0GgsWA99mXI_y6g9OvbW0iTkcSI4eVLu8m4Uu6E06JohWe_gts8lqm_nQN_ZSYF4Wq4WDw9ivys9iDdeMKPqbYBg05mVkiTi8aRdnZ5sTNWZ_8t6O0DccYDCKnIxAGxbXKyLNLWp6EiMQ Aug 06 14:41:04.058782 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Domain-Id: None Aug 06 14:41:04.058782 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Domain-Name: None Aug 06 14:41:04.058782 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Identity-Status: Confirmed Aug 06 14:41:04.058782 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Is-Admin-Project: True Aug 06 14:41:04.058782 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Openstack-Nova-Api-Version: 2.20 Aug 06 14:41:04.058782 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Domain-Id: default Aug 06 14:41:04.058782 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Domain-Name: Default Aug 06 14:41:04.058782 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Id: 2f20dc7bdc3a4448a56a76f1efbec596 Aug 06 14:41:04.058782 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-536291305 Aug 06 14:41:04.058782 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Role: member,reader Aug 06 14:41:04.058782 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Roles: member,reader Aug 06 14:41:04.060325 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2f20dc7bdc3a4448a56a76f1efbec596"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2f20dc7bdc3a4448a56a76f1efbec596"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2f20dc7bdc3a4448a56a76f1efbec596", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2f20dc7bdc3a4448a56a76f1efbec596"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 06 14:41:04.060325 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Tenant: tempest-AttachVolumeShelveTestJSON-536291305 Aug 06 14:41:04.060325 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Tenant-Id: 2f20dc7bdc3a4448a56a76f1efbec596 Aug 06 14:41:04.060325 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-536291305 Aug 06 14:41:04.060325 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User: tempest-AttachVolumeShelveTestJSON-536291305-project Aug 06 14:41:04.060325 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Domain-Id: default Aug 06 14:41:04.060325 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Domain-Name: Default Aug 06 14:41:04.060325 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Id: be34f77da4d8407e9a4333bc71f64595 Aug 06 14:41:04.060325 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Name: tempest-AttachVolumeShelveTestJSON-536291305-project Aug 06 14:41:04.060325 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: method: > Aug 06 14:41:04.060325 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: exception: Instance 91e50552-3108-4fca-82ca-e299af40061e could not be found. Aug 06 14:41:04.060325 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: action_args: {'id': '91e50552-3108-4fca-82ca-e299af40061e'} Aug 06 14:41:04.061098 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 14:41:04.061098 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:41:04.061098 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 14:41:04.061098 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 14:41:04.061098 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 14:41:04.061098 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 14:41:04.061098 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 14:41:04.061098 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 14:41:04.061098 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 14:41:04.061098 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 14:41:04.061098 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91e50552-3108-4fca-82ca-e299af40061e could not be found. Aug 06 14:41:04.061098 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:41:04.061098 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:41:04.061098 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:41:04.061098 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:41:04.061098 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:41:04.061098 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:41:04.061098 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 14:41:04.061098 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 14:41:04.061098 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 14:41:04.062454 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 14:41:04.062454 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 14:41:04.062454 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 14:41:04.062454 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 14:41:04.062454 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 14:41:04.062454 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 14:41:04.062454 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 14:41:04.062454 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91e50552-3108-4fca-82ca-e299af40061e could not be found. Aug 06 14:41:04.062454 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:41:04.062454 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:41:04.062454 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:41:04.062454 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:41:04.062454 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:41:04.062454 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:41:04.062454 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 14:41:04.062454 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 14:41:04.062454 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91e50552-3108-4fca-82ca-e299af40061e could not be found. Aug 06 14:41:04.062454 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:41:04.064148 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-bd0d4c0d-2ec5-44ce-92b3-833956591bae tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Returning 404 to user: Instance 91e50552-3108-4fca-82ca-e299af40061e could not be found. {{(pid=117838) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 14:41:04.064148 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-bd0d4c0d-2ec5-44ce-92b3-833956591bae tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e" status: 404 len: 111 microversion: 2.20 time: 0.032178 Aug 06 14:41:04.064148 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 505/1058] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:41:04 2022] GET /compute/v2.1/servers/91e50552-3108-4fca-82ca-e299af40061e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 06 14:41:05.213614 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-f6ee0ec2-95cb-43d3-9744-6e1d6500dee5 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:41:05.214106 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-f6ee0ec2-95cb-43d3-9744-6e1d6500dee5 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:41:05.222056 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f6ee0ec2-95cb-43d3-9744-6e1d6500dee5 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:41:05.222531 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f6ee0ec2-95cb-43d3-9744-6e1d6500dee5 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:41:05.223099 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f6ee0ec2-95cb-43d3-9744-6e1d6500dee5 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:41:05.223667 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f6ee0ec2-95cb-43d3-9744-6e1d6500dee5 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:41:05.224117 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f6ee0ec2-95cb-43d3-9744-6e1d6500dee5 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:41:05.224538 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f6ee0ec2-95cb-43d3-9744-6e1d6500dee5 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:41:05.238488 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.wsgi [None req-f6ee0ec2-95cb-43d3-9744-6e1d6500dee5 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] HTTP exception thrown: Instance 5cf29bae-83f8-43e3-9118-0fea5a019ff8 could not be found. Aug 06 14:41:05.240370 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-f6ee0ec2-95cb-43d3-9744-6e1d6500dee5 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Request method failure captured: Aug 06 14:41:05.240370 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: request: DELETE /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 HTTP/1.1 Aug 06 14:41:05.240370 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Accept: application/json Aug 06 14:41:05.240370 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Accept-Encoding: identity Aug 06 14:41:05.240370 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Connection: close Aug 06 14:41:05.240370 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Content-Length: 0 Aug 06 14:41:05.240370 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Content-Type: application/json Aug 06 14:41:05.240370 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Host: 10.222.0.17 Aug 06 14:41:05.240370 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Openstack-System-Scope: None Aug 06 14:41:05.240370 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: User-Agent: python-urllib3/1.26.11 Aug 06 14:41:05.240370 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Auth-Token: gAAAAABi7nrq6tL7qiEJGlB3Mk3s36rji_pwLVPV4k0GgsWA99mXI_y6g9OvbW0iTkcSI4eVLu8m4Uu6E06JohWe_gts8lqm_nQN_ZSYF4Wq4WDw9ivys9iDdeMKPqbYBg05mVkiTi8aRdnZ5sTNWZ_8t6O0DccYDCKnIxAGxbXKyLNLWp6EiMQ Aug 06 14:41:05.240370 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Domain-Id: None Aug 06 14:41:05.240370 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Domain-Name: None Aug 06 14:41:05.240370 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Identity-Status: Confirmed Aug 06 14:41:05.240370 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Is-Admin-Project: True Aug 06 14:41:05.240370 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Openstack-Nova-Api-Version: 2.20 Aug 06 14:41:05.240370 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Domain-Id: default Aug 06 14:41:05.240370 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Domain-Name: Default Aug 06 14:41:05.240370 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Id: 2f20dc7bdc3a4448a56a76f1efbec596 Aug 06 14:41:05.240370 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-536291305 Aug 06 14:41:05.240370 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Role: member,reader Aug 06 14:41:05.240370 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Roles: member,reader Aug 06 14:41:05.242111 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2f20dc7bdc3a4448a56a76f1efbec596"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2f20dc7bdc3a4448a56a76f1efbec596"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2f20dc7bdc3a4448a56a76f1efbec596", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2f20dc7bdc3a4448a56a76f1efbec596"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 06 14:41:05.242111 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant: tempest-AttachVolumeShelveTestJSON-536291305 Aug 06 14:41:05.242111 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant-Id: 2f20dc7bdc3a4448a56a76f1efbec596 Aug 06 14:41:05.242111 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-536291305 Aug 06 14:41:05.242111 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User: tempest-AttachVolumeShelveTestJSON-536291305-project Aug 06 14:41:05.242111 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Domain-Id: default Aug 06 14:41:05.242111 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Domain-Name: Default Aug 06 14:41:05.242111 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Id: be34f77da4d8407e9a4333bc71f64595 Aug 06 14:41:05.242111 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Name: tempest-AttachVolumeShelveTestJSON-536291305-project Aug 06 14:41:05.242111 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: method: > Aug 06 14:41:05.242111 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: exception: Instance 5cf29bae-83f8-43e3-9118-0fea5a019ff8 could not be found. Aug 06 14:41:05.242111 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: action_args: {'id': '5cf29bae-83f8-43e3-9118-0fea5a019ff8'} Aug 06 14:41:05.243065 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 14:41:05.243065 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:41:05.243065 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 14:41:05.243065 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 14:41:05.243065 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 14:41:05.243065 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 14:41:05.243065 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 14:41:05.243065 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 14:41:05.243065 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 14:41:05.243065 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 14:41:05.243065 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cf29bae-83f8-43e3-9118-0fea5a019ff8 could not be found. Aug 06 14:41:05.243065 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:41:05.243065 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:41:05.243065 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:41:05.243065 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:41:05.243065 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:41:05.243065 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:41:05.243065 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 14:41:05.243065 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 14:41:05.243065 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 14:41:05.244515 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 14:41:05.244515 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 14:41:05.244515 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 14:41:05.244515 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 14:41:05.244515 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 14:41:05.244515 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 14:41:05.244515 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 14:41:05.244515 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 14:41:05.244515 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 14:41:05.244515 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cf29bae-83f8-43e3-9118-0fea5a019ff8 could not be found. Aug 06 14:41:05.244515 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:41:05.244515 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:41:05.244515 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:41:05.244515 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:41:05.244515 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:41:05.244515 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:41:05.244515 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 14:41:05.244515 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 14:41:05.244515 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cf29bae-83f8-43e3-9118-0fea5a019ff8 could not be found. Aug 06 14:41:05.244515 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:41:05.245952 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-f6ee0ec2-95cb-43d3-9744-6e1d6500dee5 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Returning 404 to user: Instance 5cf29bae-83f8-43e3-9118-0fea5a019ff8 could not be found. {{(pid=117837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 14:41:05.245952 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-f6ee0ec2-95cb-43d3-9744-6e1d6500dee5 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 404 len: 111 microversion: 2.20 time: 0.031971 Aug 06 14:41:05.245952 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 554/1059] 10.222.0.17 () {60 vars in 1280 bytes} [Sat Aug 6 14:41:05 2022] DELETE /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 06 14:41:05.255627 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-3749942c-518c-4cf8-84f5-762ffd823498 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:41:05.256243 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-3749942c-518c-4cf8-84f5-762ffd823498 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] [instance: 5cf29bae-83f8-43e3-9118-0fea5a019ff8] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:41:05.264288 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3749942c-518c-4cf8-84f5-762ffd823498 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:41:05.264787 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3749942c-518c-4cf8-84f5-762ffd823498 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:41:05.265220 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3749942c-518c-4cf8-84f5-762ffd823498 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:41:05.266537 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3749942c-518c-4cf8-84f5-762ffd823498 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:41:05.267021 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3749942c-518c-4cf8-84f5-762ffd823498 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:41:05.267527 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3749942c-518c-4cf8-84f5-762ffd823498 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:41:05.287408 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.wsgi [None req-3749942c-518c-4cf8-84f5-762ffd823498 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] HTTP exception thrown: Instance 5cf29bae-83f8-43e3-9118-0fea5a019ff8 could not be found. Aug 06 14:41:05.289185 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-3749942c-518c-4cf8-84f5-762ffd823498 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Request method failure captured: Aug 06 14:41:05.289185 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: request: GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 HTTP/1.1 Aug 06 14:41:05.289185 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Accept: application/json Aug 06 14:41:05.289185 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Accept-Encoding: identity Aug 06 14:41:05.289185 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Connection: close Aug 06 14:41:05.289185 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Content-Length: 0 Aug 06 14:41:05.289185 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Content-Type: application/json Aug 06 14:41:05.289185 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Host: 10.222.0.17 Aug 06 14:41:05.289185 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Openstack-System-Scope: None Aug 06 14:41:05.289185 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: User-Agent: python-urllib3/1.26.11 Aug 06 14:41:05.289185 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Auth-Token: gAAAAABi7nrq6tL7qiEJGlB3Mk3s36rji_pwLVPV4k0GgsWA99mXI_y6g9OvbW0iTkcSI4eVLu8m4Uu6E06JohWe_gts8lqm_nQN_ZSYF4Wq4WDw9ivys9iDdeMKPqbYBg05mVkiTi8aRdnZ5sTNWZ_8t6O0DccYDCKnIxAGxbXKyLNLWp6EiMQ Aug 06 14:41:05.289185 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Domain-Id: None Aug 06 14:41:05.289185 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Domain-Name: None Aug 06 14:41:05.289185 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Identity-Status: Confirmed Aug 06 14:41:05.289185 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Is-Admin-Project: True Aug 06 14:41:05.289185 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Openstack-Nova-Api-Version: 2.20 Aug 06 14:41:05.289185 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Domain-Id: default Aug 06 14:41:05.289185 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Domain-Name: Default Aug 06 14:41:05.289185 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Id: 2f20dc7bdc3a4448a56a76f1efbec596 Aug 06 14:41:05.289185 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-536291305 Aug 06 14:41:05.289185 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Role: member,reader Aug 06 14:41:05.289185 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Roles: member,reader Aug 06 14:41:05.291067 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2f20dc7bdc3a4448a56a76f1efbec596"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2f20dc7bdc3a4448a56a76f1efbec596"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2f20dc7bdc3a4448a56a76f1efbec596", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2f20dc7bdc3a4448a56a76f1efbec596"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 06 14:41:05.291067 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Tenant: tempest-AttachVolumeShelveTestJSON-536291305 Aug 06 14:41:05.291067 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Tenant-Id: 2f20dc7bdc3a4448a56a76f1efbec596 Aug 06 14:41:05.291067 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-536291305 Aug 06 14:41:05.291067 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User: tempest-AttachVolumeShelveTestJSON-536291305-project Aug 06 14:41:05.291067 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Domain-Id: default Aug 06 14:41:05.291067 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Domain-Name: Default Aug 06 14:41:05.291067 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Id: be34f77da4d8407e9a4333bc71f64595 Aug 06 14:41:05.291067 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Name: tempest-AttachVolumeShelveTestJSON-536291305-project Aug 06 14:41:05.291067 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: method: > Aug 06 14:41:05.291067 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: exception: Instance 5cf29bae-83f8-43e3-9118-0fea5a019ff8 could not be found. Aug 06 14:41:05.291067 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: action_args: {'id': '5cf29bae-83f8-43e3-9118-0fea5a019ff8'} Aug 06 14:41:05.295454 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 14:41:05.295454 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:41:05.295454 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 14:41:05.295454 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 14:41:05.295454 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 14:41:05.295454 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 14:41:05.295454 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 14:41:05.295454 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 14:41:05.295454 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 14:41:05.295454 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 14:41:05.295454 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cf29bae-83f8-43e3-9118-0fea5a019ff8 could not be found. Aug 06 14:41:05.295454 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:41:05.295454 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:41:05.295454 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:41:05.295454 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:41:05.295454 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:41:05.295454 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:41:05.295454 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 14:41:05.295454 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 14:41:05.295454 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 14:41:05.297315 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 14:41:05.297315 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 14:41:05.297315 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 14:41:05.297315 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 14:41:05.297315 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 14:41:05.297315 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 14:41:05.297315 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 14:41:05.297315 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cf29bae-83f8-43e3-9118-0fea5a019ff8 could not be found. Aug 06 14:41:05.297315 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:41:05.297315 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:41:05.297315 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:41:05.297315 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:41:05.297315 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:41:05.297315 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:41:05.297315 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 14:41:05.297315 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 14:41:05.297315 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cf29bae-83f8-43e3-9118-0fea5a019ff8 could not be found. Aug 06 14:41:05.297315 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:41:05.298681 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-3749942c-518c-4cf8-84f5-762ffd823498 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] Returning 404 to user: Instance 5cf29bae-83f8-43e3-9118-0fea5a019ff8 could not be found. {{(pid=117838) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 14:41:05.298681 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-3749942c-518c-4cf8-84f5-762ffd823498 tempest-AttachVolumeShelveTestJSON-536291305 tempest-AttachVolumeShelveTestJSON-536291305-project] 10.222.0.17 "GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8" status: 404 len: 111 microversion: 2.20 time: 0.039339 Aug 06 14:41:05.298681 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 506/1060] 10.222.0.17 () {60 vars in 1277 bytes} [Sat Aug 6 14:41:05 2022] GET /compute/v2.1/servers/5cf29bae-83f8-43e3-9118-0fea5a019ff8 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 06 14:41:34.460567 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 14:41:34.461199 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Sat Aug 6 14:41:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 14:41:47.891805 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-0dced9e9-9fa0-4fac-b640-d7b1362d1b1c tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2060003982", "imageRef": "13d7ee60-c9c3-43ee-9861-a9192a114a77", "flavorRef": "452", "networks": [{"uuid": "58ce13ba-43d4-4fc4-a0de-8643109e23aa"}]}} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:41:47.905618 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_api:SELECT=3 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:41:47.906805 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_cell1:SELECT=3 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:41:47.956547 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.network.neutron [None req-0dced9e9-9fa0-4fac-b640-d7b1362d1b1c tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] validate_networks() for [('58ce13ba-43d4-4fc4-a0de-8643109e23aa', None, None, None, None, None)] {{(pid=117837) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 14:41:48.410063 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.virt.hardware [None req-0dced9e9-9fa0-4fac-b640-d7b1362d1b1c tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Flavor limits 0:0:0 {{(pid=117837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 14:41:48.410485 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.virt.hardware [None req-0dced9e9-9fa0-4fac-b640-d7b1362d1b1c tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Image limits 0:0:0 {{(pid=117837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 14:41:48.410999 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.virt.hardware [None req-0dced9e9-9fa0-4fac-b640-d7b1362d1b1c tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Flavor pref 0:0:0 {{(pid=117837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 14:41:48.411409 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.virt.hardware [None req-0dced9e9-9fa0-4fac-b640-d7b1362d1b1c tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Image pref 0:0:0 {{(pid=117837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 14:41:48.411819 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.virt.hardware [None req-0dced9e9-9fa0-4fac-b640-d7b1362d1b1c tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 14:41:48.420490 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0dced9e9-9fa0-4fac-b640-d7b1362d1b1c tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:41:48.420968 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0dced9e9-9fa0-4fac-b640-d7b1362d1b1c tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:41:48.421405 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0dced9e9-9fa0-4fac-b640-d7b1362d1b1c tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:41:48.422158 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0dced9e9-9fa0-4fac-b640-d7b1362d1b1c tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:41:48.422638 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0dced9e9-9fa0-4fac-b640-d7b1362d1b1c tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:41:48.423091 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0dced9e9-9fa0-4fac-b640-d7b1362d1b1c tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:41:48.440055 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.quota [None req-0dced9e9-9fa0-4fac-b640-d7b1362d1b1c tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Getting quotas for project 4bd221dfff634404a071ad30db96b99d. Resources: {'cores', 'instances', 'ram'} {{(pid=117837) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 14:41:48.443986 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.quota [None req-0dced9e9-9fa0-4fac-b640-d7b1362d1b1c tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Getting quotas for user 418f616114fa430cbc73d8cbe3263c52 and project 4bd221dfff634404a071ad30db96b99d. Resources: {'cores', 'instances', 'ram'} {{(pid=117837) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 14:41:48.455879 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-0dced9e9-9fa0-4fac-b640-d7b1362d1b1c tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Going to run 1 instances... {{(pid=117837) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 14:41:48.458078 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-0dced9e9-9fa0-4fac-b640-d7b1362d1b1c tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] [instance: 5e670c47-e74e-4764-bda3-2c4e26e6e4bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='13d7ee60-c9c3-43ee-9861-a9192a114a77',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117837) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 14:41:48.498617 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0dced9e9-9fa0-4fac-b640-d7b1362d1b1c tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] [ca80ca8b-540c-43fb-84da-f664732c56c6] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 06 14:41:49.505902 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO oslo.messaging._drivers.impl_rabbit [None req-0dced9e9-9fa0-4fac-b640-d7b1362d1b1c tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] [ca80ca8b-540c-43fb-84da-f664732c56c6] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 50474. Aug 06 14:41:49.510173 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-0dced9e9-9fa0-4fac-b640-d7b1362d1b1c tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.624431 Aug 06 14:41:49.510961 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 555/1061] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Aug 6 14:41:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 14:41:49.522267 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-042500f2-918b-499f-8268-5eaff8d2d091 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:41:49.522993 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-042500f2-918b-499f-8268-5eaff8d2d091 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] [instance: 5e670c47-e74e-4764-bda3-2c4e26e6e4bc] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:41:49.526663 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:41:49.527459 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_cell1:SELECT=69,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:41:49.591518 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-042500f2-918b-499f-8268-5eaff8d2d091 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f616114fa430cbc73d8cbe3263c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd221dfff634404a071ad30db96b99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:41:49.599662 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-042500f2-918b-499f-8268-5eaff8d2d091 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] 10.222.0.17 "GET /compute/v2.1/servers/5e670c47-e74e-4764-bda3-2c4e26e6e4bc" status: 200 len: 1214 microversion: 2.1 time: 0.081188 Aug 06 14:41:49.600413 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 507/1062] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:41:49 2022] GET /compute/v2.1/servers/5e670c47-e74e-4764-bda3-2c4e26e6e4bc => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:41:50.621739 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-1cb56336-da23-42b1-bb6a-63f1be74cc43 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:41:50.623410 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-1cb56336-da23-42b1-bb6a-63f1be74cc43 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] [instance: 5e670c47-e74e-4764-bda3-2c4e26e6e4bc] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:41:50.632258 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1cb56336-da23-42b1-bb6a-63f1be74cc43 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:41:50.633252 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1cb56336-da23-42b1-bb6a-63f1be74cc43 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:41:50.633798 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1cb56336-da23-42b1-bb6a-63f1be74cc43 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:41:50.634907 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1cb56336-da23-42b1-bb6a-63f1be74cc43 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:41:50.635285 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1cb56336-da23-42b1-bb6a-63f1be74cc43 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:41:50.635797 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1cb56336-da23-42b1-bb6a-63f1be74cc43 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:41:50.724023 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-1cb56336-da23-42b1-bb6a-63f1be74cc43 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f616114fa430cbc73d8cbe3263c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd221dfff634404a071ad30db96b99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:41:50.732774 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-1cb56336-da23-42b1-bb6a-63f1be74cc43 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] 10.222.0.17 "GET /compute/v2.1/servers/5e670c47-e74e-4764-bda3-2c4e26e6e4bc" status: 200 len: 1266 microversion: 2.1 time: 0.115949 Aug 06 14:41:50.746899 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 556/1063] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:41:50 2022] GET /compute/v2.1/servers/5e670c47-e74e-4764-bda3-2c4e26e6e4bc => generated 1266 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:41:51.755104 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-c388ff73-86b4-45cc-b0e6-14e93537f11e tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:41:51.756578 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-c388ff73-86b4-45cc-b0e6-14e93537f11e tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] [instance: 5e670c47-e74e-4764-bda3-2c4e26e6e4bc] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:41:51.763956 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c388ff73-86b4-45cc-b0e6-14e93537f11e tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:41:51.764886 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c388ff73-86b4-45cc-b0e6-14e93537f11e tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:41:51.765331 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c388ff73-86b4-45cc-b0e6-14e93537f11e tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:41:51.766261 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c388ff73-86b4-45cc-b0e6-14e93537f11e tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:41:51.766730 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c388ff73-86b4-45cc-b0e6-14e93537f11e tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:41:51.767174 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c388ff73-86b4-45cc-b0e6-14e93537f11e tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:41:51.918594 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-c388ff73-86b4-45cc-b0e6-14e93537f11e tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f616114fa430cbc73d8cbe3263c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd221dfff634404a071ad30db96b99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:41:51.927491 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-c388ff73-86b4-45cc-b0e6-14e93537f11e tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] 10.222.0.17 "GET /compute/v2.1/servers/5e670c47-e74e-4764-bda3-2c4e26e6e4bc" status: 200 len: 1314 microversion: 2.1 time: 0.177810 Aug 06 14:41:51.929504 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 508/1064] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:41:51 2022] GET /compute/v2.1/servers/5e670c47-e74e-4764-bda3-2c4e26e6e4bc => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:41:52.357516 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [req-3d0046a3-7fb4-4805-920b-9a9456c1f6f5 req-ab6a44a0-832c-45cd-9285-9b2e809d35d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e670c47-e74e-4764-bda3-2c4e26e6e4bc", "tag": "6be65db1-0c23-4d28-8a96-be4bbf365331"}]} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:41:52.373277 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-3d0046a3-7fb4-4805-920b-9a9456c1f6f5 req-ab6a44a0-832c-45cd-9285-9b2e809d35d4 service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:41:52.373995 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-3d0046a3-7fb4-4805-920b-9a9456c1f6f5 req-ab6a44a0-832c-45cd-9285-9b2e809d35d4 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:41:52.374612 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-3d0046a3-7fb4-4805-920b-9a9456c1f6f5 req-ab6a44a0-832c-45cd-9285-9b2e809d35d4 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:41:52.388508 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.compute.server_external_events [req-3d0046a3-7fb4-4805-920b-9a9456c1f6f5 req-ab6a44a0-832c-45cd-9285-9b2e809d35d4 service nova] Creating event network-changed:6be65db1-0c23-4d28-8a96-be4bbf365331 for instance 5e670c47-e74e-4764-bda3-2c4e26e6e4bc on hv-cinder-85199 Aug 06 14:41:52.395002 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [req-3d0046a3-7fb4-4805-920b-9a9456c1f6f5 req-ab6a44a0-832c-45cd-9285-9b2e809d35d4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043696 Aug 06 14:41:52.396077 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 557/1065] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:41:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:41:52.950148 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-35b919c9-8451-43f1-9d3e-f523e6dc5fd1 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:41:52.950927 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-35b919c9-8451-43f1-9d3e-f523e6dc5fd1 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] [instance: 5e670c47-e74e-4764-bda3-2c4e26e6e4bc] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:41:52.958589 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-35b919c9-8451-43f1-9d3e-f523e6dc5fd1 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:41:52.959385 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-35b919c9-8451-43f1-9d3e-f523e6dc5fd1 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:41:52.960314 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-35b919c9-8451-43f1-9d3e-f523e6dc5fd1 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:41:52.961218 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-35b919c9-8451-43f1-9d3e-f523e6dc5fd1 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:41:52.961739 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-35b919c9-8451-43f1-9d3e-f523e6dc5fd1 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:41:52.962579 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-35b919c9-8451-43f1-9d3e-f523e6dc5fd1 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:41:53.124670 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-35b919c9-8451-43f1-9d3e-f523e6dc5fd1 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f616114fa430cbc73d8cbe3263c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd221dfff634404a071ad30db96b99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:41:53.132468 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-35b919c9-8451-43f1-9d3e-f523e6dc5fd1 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] 10.222.0.17 "GET /compute/v2.1/servers/5e670c47-e74e-4764-bda3-2c4e26e6e4bc" status: 200 len: 1314 microversion: 2.1 time: 0.186338 Aug 06 14:41:53.132751 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 509/1066] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:41:52 2022] GET /compute/v2.1/servers/5e670c47-e74e-4764-bda3-2c4e26e6e4bc => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:41:54.156076 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-6c755da2-9a96-4fb2-ab3e-5e1d264d74fe tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:41:54.156973 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-6c755da2-9a96-4fb2-ab3e-5e1d264d74fe tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] [instance: 5e670c47-e74e-4764-bda3-2c4e26e6e4bc] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:41:54.163970 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6c755da2-9a96-4fb2-ab3e-5e1d264d74fe tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:41:54.164540 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6c755da2-9a96-4fb2-ab3e-5e1d264d74fe tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:41:54.165050 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6c755da2-9a96-4fb2-ab3e-5e1d264d74fe tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:41:54.165816 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6c755da2-9a96-4fb2-ab3e-5e1d264d74fe tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:41:54.166339 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6c755da2-9a96-4fb2-ab3e-5e1d264d74fe tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:41:54.166757 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6c755da2-9a96-4fb2-ab3e-5e1d264d74fe tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:41:54.300917 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-6c755da2-9a96-4fb2-ab3e-5e1d264d74fe tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f616114fa430cbc73d8cbe3263c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd221dfff634404a071ad30db96b99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:41:54.310558 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-6c755da2-9a96-4fb2-ab3e-5e1d264d74fe tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] 10.222.0.17 "GET /compute/v2.1/servers/5e670c47-e74e-4764-bda3-2c4e26e6e4bc" status: 200 len: 1314 microversion: 2.1 time: 0.158806 Aug 06 14:41:54.311233 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 558/1067] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:41:54 2022] GET /compute/v2.1/servers/5e670c47-e74e-4764-bda3-2c4e26e6e4bc => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:41:55.331894 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-ad06d51c-1768-4074-b632-774c0699ac4f tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:41:55.332530 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-ad06d51c-1768-4074-b632-774c0699ac4f tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] [instance: 5e670c47-e74e-4764-bda3-2c4e26e6e4bc] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:41:55.339214 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ad06d51c-1768-4074-b632-774c0699ac4f tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:41:55.339702 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ad06d51c-1768-4074-b632-774c0699ac4f tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:41:55.340133 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ad06d51c-1768-4074-b632-774c0699ac4f tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:41:55.340824 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ad06d51c-1768-4074-b632-774c0699ac4f tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:41:55.341280 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ad06d51c-1768-4074-b632-774c0699ac4f tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:41:55.341705 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ad06d51c-1768-4074-b632-774c0699ac4f tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:41:55.481680 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-ad06d51c-1768-4074-b632-774c0699ac4f tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f616114fa430cbc73d8cbe3263c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd221dfff634404a071ad30db96b99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:41:55.492336 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-ad06d51c-1768-4074-b632-774c0699ac4f tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] 10.222.0.17 "GET /compute/v2.1/servers/5e670c47-e74e-4764-bda3-2c4e26e6e4bc" status: 200 len: 1314 microversion: 2.1 time: 0.163425 Aug 06 14:41:55.492336 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 510/1068] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:41:55 2022] GET /compute/v2.1/servers/5e670c47-e74e-4764-bda3-2c4e26e6e4bc => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:41:56.512349 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-ed1d4897-0413-4b3e-9104-6bed43f32999 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:41:56.513089 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-ed1d4897-0413-4b3e-9104-6bed43f32999 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] [instance: 5e670c47-e74e-4764-bda3-2c4e26e6e4bc] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:41:56.520364 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ed1d4897-0413-4b3e-9104-6bed43f32999 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:41:56.520984 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ed1d4897-0413-4b3e-9104-6bed43f32999 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:41:56.521495 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ed1d4897-0413-4b3e-9104-6bed43f32999 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:41:56.522259 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ed1d4897-0413-4b3e-9104-6bed43f32999 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:41:56.522708 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ed1d4897-0413-4b3e-9104-6bed43f32999 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:41:56.523154 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ed1d4897-0413-4b3e-9104-6bed43f32999 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:41:56.660599 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-ed1d4897-0413-4b3e-9104-6bed43f32999 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f616114fa430cbc73d8cbe3263c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd221dfff634404a071ad30db96b99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:41:56.668101 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-ed1d4897-0413-4b3e-9104-6bed43f32999 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] 10.222.0.17 "GET /compute/v2.1/servers/5e670c47-e74e-4764-bda3-2c4e26e6e4bc" status: 200 len: 1314 microversion: 2.1 time: 0.159762 Aug 06 14:41:56.669080 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 559/1069] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:41:56 2022] GET /compute/v2.1/servers/5e670c47-e74e-4764-bda3-2c4e26e6e4bc => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:41:57.694317 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-c1fb3d91-a25f-40da-bd20-47187dba3c31 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:41:57.695081 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-c1fb3d91-a25f-40da-bd20-47187dba3c31 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] [instance: 5e670c47-e74e-4764-bda3-2c4e26e6e4bc] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:41:57.701896 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c1fb3d91-a25f-40da-bd20-47187dba3c31 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:41:57.702387 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c1fb3d91-a25f-40da-bd20-47187dba3c31 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:41:57.702847 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c1fb3d91-a25f-40da-bd20-47187dba3c31 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:41:57.703775 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c1fb3d91-a25f-40da-bd20-47187dba3c31 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:41:57.704228 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c1fb3d91-a25f-40da-bd20-47187dba3c31 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:41:57.704648 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c1fb3d91-a25f-40da-bd20-47187dba3c31 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:41:57.838916 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-c1fb3d91-a25f-40da-bd20-47187dba3c31 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f616114fa430cbc73d8cbe3263c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd221dfff634404a071ad30db96b99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:41:57.847671 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-c1fb3d91-a25f-40da-bd20-47187dba3c31 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] 10.222.0.17 "GET /compute/v2.1/servers/5e670c47-e74e-4764-bda3-2c4e26e6e4bc" status: 200 len: 1314 microversion: 2.1 time: 0.157054 Aug 06 14:41:57.848421 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 511/1070] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:41:57 2022] GET /compute/v2.1/servers/5e670c47-e74e-4764-bda3-2c4e26e6e4bc => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:41:58.868834 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-6ace2c12-e354-455e-b3e9-848b0ac940f5 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:41:58.869455 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-6ace2c12-e354-455e-b3e9-848b0ac940f5 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] [instance: 5e670c47-e74e-4764-bda3-2c4e26e6e4bc] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:41:58.871938 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_cell0:SELECT=2 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:41:58.872695 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_cell0:SELECT=6 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:41:58.879269 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6ace2c12-e354-455e-b3e9-848b0ac940f5 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:41:58.879757 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6ace2c12-e354-455e-b3e9-848b0ac940f5 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:41:58.880198 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6ace2c12-e354-455e-b3e9-848b0ac940f5 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:41:58.880899 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6ace2c12-e354-455e-b3e9-848b0ac940f5 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:41:58.881361 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6ace2c12-e354-455e-b3e9-848b0ac940f5 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:41:58.881789 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6ace2c12-e354-455e-b3e9-848b0ac940f5 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:41:59.024894 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-6ace2c12-e354-455e-b3e9-848b0ac940f5 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f616114fa430cbc73d8cbe3263c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd221dfff634404a071ad30db96b99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:41:59.033301 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-6ace2c12-e354-455e-b3e9-848b0ac940f5 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] 10.222.0.17 "GET /compute/v2.1/servers/5e670c47-e74e-4764-bda3-2c4e26e6e4bc" status: 200 len: 1314 microversion: 2.1 time: 0.168368 Aug 06 14:41:59.033984 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 560/1071] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:41:58 2022] GET /compute/v2.1/servers/5e670c47-e74e-4764-bda3-2c4e26e6e4bc => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:42:00.056231 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-7895e9f8-e31c-48ef-ad0a-af5f4dfe2496 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:42:00.056849 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-7895e9f8-e31c-48ef-ad0a-af5f4dfe2496 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] [instance: 5e670c47-e74e-4764-bda3-2c4e26e6e4bc] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:42:00.059512 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_cell0:SELECT=2 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:42:00.065448 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7895e9f8-e31c-48ef-ad0a-af5f4dfe2496 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:42:00.065926 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7895e9f8-e31c-48ef-ad0a-af5f4dfe2496 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:42:00.066354 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7895e9f8-e31c-48ef-ad0a-af5f4dfe2496 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:42:00.067079 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7895e9f8-e31c-48ef-ad0a-af5f4dfe2496 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:42:00.067534 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7895e9f8-e31c-48ef-ad0a-af5f4dfe2496 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:42:00.067958 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7895e9f8-e31c-48ef-ad0a-af5f4dfe2496 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:42:00.200690 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-7895e9f8-e31c-48ef-ad0a-af5f4dfe2496 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f616114fa430cbc73d8cbe3263c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd221dfff634404a071ad30db96b99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:42:00.208181 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-7895e9f8-e31c-48ef-ad0a-af5f4dfe2496 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] 10.222.0.17 "GET /compute/v2.1/servers/5e670c47-e74e-4764-bda3-2c4e26e6e4bc" status: 200 len: 1314 microversion: 2.1 time: 0.156611 Aug 06 14:42:00.208733 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 512/1072] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:42:00 2022] GET /compute/v2.1/servers/5e670c47-e74e-4764-bda3-2c4e26e6e4bc => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:42:00.647499 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [req-f066dbc5-640a-4966-9761-00df24d92dc8 req-c8dc277f-d0f2-45e3-b3e2-dd81f4de5f33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e670c47-e74e-4764-bda3-2c4e26e6e4bc", "name": "network-vif-plugged", "status": "completed", "tag": "6be65db1-0c23-4d28-8a96-be4bbf365331"}]} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:42:00.657370 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-f066dbc5-640a-4966-9761-00df24d92dc8 req-c8dc277f-d0f2-45e3-b3e2-dd81f4de5f33 service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:42:00.657842 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-f066dbc5-640a-4966-9761-00df24d92dc8 req-c8dc277f-d0f2-45e3-b3e2-dd81f4de5f33 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:42:00.658266 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-f066dbc5-640a-4966-9761-00df24d92dc8 req-c8dc277f-d0f2-45e3-b3e2-dd81f4de5f33 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:42:00.669527 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.compute.server_external_events [req-f066dbc5-640a-4966-9761-00df24d92dc8 req-c8dc277f-d0f2-45e3-b3e2-dd81f4de5f33 service nova] Creating event network-vif-plugged:6be65db1-0c23-4d28-8a96-be4bbf365331 for instance 5e670c47-e74e-4764-bda3-2c4e26e6e4bc on hv-cinder-85199 Aug 06 14:42:00.674474 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [req-f066dbc5-640a-4966-9761-00df24d92dc8 req-c8dc277f-d0f2-45e3-b3e2-dd81f4de5f33 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160624 Aug 06 14:42:00.675092 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 561/1073] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:42:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:42:01.230202 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-5ec14e4c-e83c-4680-90a2-0771fd922fee tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:42:01.230833 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-5ec14e4c-e83c-4680-90a2-0771fd922fee tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] [instance: 5e670c47-e74e-4764-bda3-2c4e26e6e4bc] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:42:01.238225 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5ec14e4c-e83c-4680-90a2-0771fd922fee tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:42:01.238722 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5ec14e4c-e83c-4680-90a2-0771fd922fee tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:42:01.239195 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5ec14e4c-e83c-4680-90a2-0771fd922fee tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:42:01.239908 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5ec14e4c-e83c-4680-90a2-0771fd922fee tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:42:01.240554 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5ec14e4c-e83c-4680-90a2-0771fd922fee tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:42:01.240978 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5ec14e4c-e83c-4680-90a2-0771fd922fee tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:42:01.380756 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-5ec14e4c-e83c-4680-90a2-0771fd922fee tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f616114fa430cbc73d8cbe3263c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd221dfff634404a071ad30db96b99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:42:01.388316 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-5ec14e4c-e83c-4680-90a2-0771fd922fee tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] 10.222.0.17 "GET /compute/v2.1/servers/5e670c47-e74e-4764-bda3-2c4e26e6e4bc" status: 200 len: 1314 microversion: 2.1 time: 0.162099 Aug 06 14:42:01.389014 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 513/1074] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:42:01 2022] GET /compute/v2.1/servers/5e670c47-e74e-4764-bda3-2c4e26e6e4bc => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:42:02.412323 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-ffcfc92c-481d-400a-91fb-47840d4e3afc tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:42:02.413022 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-ffcfc92c-481d-400a-91fb-47840d4e3afc tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] [instance: 5e670c47-e74e-4764-bda3-2c4e26e6e4bc] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:42:02.419079 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ffcfc92c-481d-400a-91fb-47840d4e3afc tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:42:02.419561 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ffcfc92c-481d-400a-91fb-47840d4e3afc tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:42:02.419994 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ffcfc92c-481d-400a-91fb-47840d4e3afc tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:42:02.420684 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ffcfc92c-481d-400a-91fb-47840d4e3afc tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:42:02.421135 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ffcfc92c-481d-400a-91fb-47840d4e3afc tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:42:02.421587 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ffcfc92c-481d-400a-91fb-47840d4e3afc tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:42:02.576145 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-ffcfc92c-481d-400a-91fb-47840d4e3afc tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f616114fa430cbc73d8cbe3263c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd221dfff634404a071ad30db96b99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:42:02.586463 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-ffcfc92c-481d-400a-91fb-47840d4e3afc tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] 10.222.0.17 "GET /compute/v2.1/servers/5e670c47-e74e-4764-bda3-2c4e26e6e4bc" status: 200 len: 1314 microversion: 2.1 time: 0.178741 Aug 06 14:42:02.599030 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 562/1075] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:42:02 2022] GET /compute/v2.1/servers/5e670c47-e74e-4764-bda3-2c4e26e6e4bc => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:42:03.607967 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-eef02dd8-0142-4f1e-aaaa-a4025d73a9b3 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:42:03.608683 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-eef02dd8-0142-4f1e-aaaa-a4025d73a9b3 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] [instance: 5e670c47-e74e-4764-bda3-2c4e26e6e4bc] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:42:03.615293 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-eef02dd8-0142-4f1e-aaaa-a4025d73a9b3 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:42:03.615773 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-eef02dd8-0142-4f1e-aaaa-a4025d73a9b3 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:42:03.616210 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-eef02dd8-0142-4f1e-aaaa-a4025d73a9b3 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:42:03.616895 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-eef02dd8-0142-4f1e-aaaa-a4025d73a9b3 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:42:03.617347 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-eef02dd8-0142-4f1e-aaaa-a4025d73a9b3 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:42:03.617765 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-eef02dd8-0142-4f1e-aaaa-a4025d73a9b3 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:42:03.754909 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-eef02dd8-0142-4f1e-aaaa-a4025d73a9b3 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f616114fa430cbc73d8cbe3263c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd221dfff634404a071ad30db96b99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:42:03.762754 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-eef02dd8-0142-4f1e-aaaa-a4025d73a9b3 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] 10.222.0.17 "GET /compute/v2.1/servers/5e670c47-e74e-4764-bda3-2c4e26e6e4bc" status: 200 len: 1497 microversion: 2.1 time: 0.158795 Aug 06 14:42:03.763349 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 514/1076] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:42:03 2022] GET /compute/v2.1/servers/5e670c47-e74e-4764-bda3-2c4e26e6e4bc => generated 1497 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:42:04.752643 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-c81cf78b-0036-4654-a504-1429d9e08f2f tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:42:04.753131 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-c81cf78b-0036-4654-a504-1429d9e08f2f tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] [instance: 5e670c47-e74e-4764-bda3-2c4e26e6e4bc] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:42:04.759731 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c81cf78b-0036-4654-a504-1429d9e08f2f tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:42:04.760206 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c81cf78b-0036-4654-a504-1429d9e08f2f tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:42:04.760641 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c81cf78b-0036-4654-a504-1429d9e08f2f tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:42:04.761320 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c81cf78b-0036-4654-a504-1429d9e08f2f tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:42:04.761767 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c81cf78b-0036-4654-a504-1429d9e08f2f tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:42:04.762186 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c81cf78b-0036-4654-a504-1429d9e08f2f tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:42:04.789677 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-c81cf78b-0036-4654-a504-1429d9e08f2f tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] [instance: 5e670c47-e74e-4764-bda3-2c4e26e6e4bc] Going to try to terminate instance {{(pid=117837) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 14:42:04.874129 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-c81cf78b-0036-4654-a504-1429d9e08f2f tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] 10.222.0.17 "DELETE /compute/v2.1/servers/5e670c47-e74e-4764-bda3-2c4e26e6e4bc" status: 204 len: 0 microversion: 2.1 time: 0.125771 Aug 06 14:42:04.876028 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 563/1077] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Aug 6 14:42:04 2022] DELETE /compute/v2.1/servers/5e670c47-e74e-4764-bda3-2c4e26e6e4bc => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 14:42:04.883362 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-c81b1945-bac2-414e-bec2-e9d941c5aad6 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:42:04.884136 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-c81b1945-bac2-414e-bec2-e9d941c5aad6 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] [instance: 5e670c47-e74e-4764-bda3-2c4e26e6e4bc] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:42:04.890987 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c81b1945-bac2-414e-bec2-e9d941c5aad6 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:42:04.891478 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c81b1945-bac2-414e-bec2-e9d941c5aad6 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:42:04.891916 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c81b1945-bac2-414e-bec2-e9d941c5aad6 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:42:04.892615 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c81b1945-bac2-414e-bec2-e9d941c5aad6 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:42:04.893069 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c81b1945-bac2-414e-bec2-e9d941c5aad6 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:42:04.893492 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c81b1945-bac2-414e-bec2-e9d941c5aad6 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:42:05.025331 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-c81b1945-bac2-414e-bec2-e9d941c5aad6 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f616114fa430cbc73d8cbe3263c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd221dfff634404a071ad30db96b99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:42:05.033622 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-c81b1945-bac2-414e-bec2-e9d941c5aad6 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] 10.222.0.17 "GET /compute/v2.1/servers/5e670c47-e74e-4764-bda3-2c4e26e6e4bc" status: 200 len: 1503 microversion: 2.1 time: 0.154081 Aug 06 14:42:05.034210 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 515/1078] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:42:04 2022] GET /compute/v2.1/servers/5e670c47-e74e-4764-bda3-2c4e26e6e4bc => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:42:06.055105 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-afbde2cc-d2f4-43b5-a531-c67d960189b1 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:42:06.055800 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-afbde2cc-d2f4-43b5-a531-c67d960189b1 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] [instance: 5e670c47-e74e-4764-bda3-2c4e26e6e4bc] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:42:06.062728 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-afbde2cc-d2f4-43b5-a531-c67d960189b1 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:42:06.063792 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-afbde2cc-d2f4-43b5-a531-c67d960189b1 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:42:06.064225 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-afbde2cc-d2f4-43b5-a531-c67d960189b1 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:42:06.064945 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-afbde2cc-d2f4-43b5-a531-c67d960189b1 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:42:06.065414 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-afbde2cc-d2f4-43b5-a531-c67d960189b1 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:42:06.065816 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-afbde2cc-d2f4-43b5-a531-c67d960189b1 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:42:06.202222 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-afbde2cc-d2f4-43b5-a531-c67d960189b1 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f616114fa430cbc73d8cbe3263c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd221dfff634404a071ad30db96b99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:42:06.210555 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-afbde2cc-d2f4-43b5-a531-c67d960189b1 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] 10.222.0.17 "GET /compute/v2.1/servers/5e670c47-e74e-4764-bda3-2c4e26e6e4bc" status: 200 len: 1503 microversion: 2.1 time: 0.159638 Aug 06 14:42:06.211153 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 564/1079] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:42:06 2022] GET /compute/v2.1/servers/5e670c47-e74e-4764-bda3-2c4e26e6e4bc => generated 1503 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:42:07.231396 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-0126b283-3037-47fe-b0ca-878deaadcf12 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:42:07.232001 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-0126b283-3037-47fe-b0ca-878deaadcf12 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] [instance: 5e670c47-e74e-4764-bda3-2c4e26e6e4bc] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:42:07.238333 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0126b283-3037-47fe-b0ca-878deaadcf12 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:42:07.238807 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0126b283-3037-47fe-b0ca-878deaadcf12 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:42:07.239265 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0126b283-3037-47fe-b0ca-878deaadcf12 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:42:07.239952 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0126b283-3037-47fe-b0ca-878deaadcf12 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:42:07.240401 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0126b283-3037-47fe-b0ca-878deaadcf12 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:42:07.240818 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0126b283-3037-47fe-b0ca-878deaadcf12 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:42:07.374311 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-0126b283-3037-47fe-b0ca-878deaadcf12 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f616114fa430cbc73d8cbe3263c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd221dfff634404a071ad30db96b99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:42:07.382411 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-0126b283-3037-47fe-b0ca-878deaadcf12 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] 10.222.0.17 "GET /compute/v2.1/servers/5e670c47-e74e-4764-bda3-2c4e26e6e4bc" status: 200 len: 1503 microversion: 2.1 time: 0.154871 Aug 06 14:42:07.383284 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 516/1080] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:42:07 2022] GET /compute/v2.1/servers/5e670c47-e74e-4764-bda3-2c4e26e6e4bc => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:42:07.593976 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [req-7b76896d-550a-4e1f-9581-9266ba58be16 req-1730c009-08fa-413c-a442-e9d93eedb6f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e670c47-e74e-4764-bda3-2c4e26e6e4bc", "name": "network-vif-deleted", "tag": "6be65db1-0c23-4d28-8a96-be4bbf365331"}]} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:42:07.603956 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-7b76896d-550a-4e1f-9581-9266ba58be16 req-1730c009-08fa-413c-a442-e9d93eedb6f9 service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:42:07.604436 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-7b76896d-550a-4e1f-9581-9266ba58be16 req-1730c009-08fa-413c-a442-e9d93eedb6f9 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:42:07.604950 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-7b76896d-550a-4e1f-9581-9266ba58be16 req-1730c009-08fa-413c-a442-e9d93eedb6f9 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:42:07.617097 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.compute.server_external_events [req-7b76896d-550a-4e1f-9581-9266ba58be16 req-1730c009-08fa-413c-a442-e9d93eedb6f9 service nova] Creating event network-vif-deleted:6be65db1-0c23-4d28-8a96-be4bbf365331 for instance 5e670c47-e74e-4764-bda3-2c4e26e6e4bc on hv-cinder-85199 Aug 06 14:42:07.622506 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [req-7b76896d-550a-4e1f-9581-9266ba58be16 req-1730c009-08fa-413c-a442-e9d93eedb6f9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033088 Aug 06 14:42:07.623121 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 565/1081] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:42:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:42:08.403783 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-5a69be46-a1a8-4db3-bd53-61d8e112a00b tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:42:08.404402 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-5a69be46-a1a8-4db3-bd53-61d8e112a00b tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] [instance: 5e670c47-e74e-4764-bda3-2c4e26e6e4bc] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:42:08.411965 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5a69be46-a1a8-4db3-bd53-61d8e112a00b tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:42:08.412450 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5a69be46-a1a8-4db3-bd53-61d8e112a00b tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:42:08.412885 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5a69be46-a1a8-4db3-bd53-61d8e112a00b tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:42:08.413570 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5a69be46-a1a8-4db3-bd53-61d8e112a00b tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:42:08.414025 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5a69be46-a1a8-4db3-bd53-61d8e112a00b tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:42:08.414468 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5a69be46-a1a8-4db3-bd53-61d8e112a00b tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:42:08.428305 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.wsgi [None req-5a69be46-a1a8-4db3-bd53-61d8e112a00b tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] HTTP exception thrown: Instance 5e670c47-e74e-4764-bda3-2c4e26e6e4bc could not be found. Aug 06 14:42:08.429805 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-5a69be46-a1a8-4db3-bd53-61d8e112a00b tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Request method failure captured: Aug 06 14:42:08.429805 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: request: GET /compute/v2.1/servers/5e670c47-e74e-4764-bda3-2c4e26e6e4bc HTTP/1.1 Aug 06 14:42:08.429805 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Accept: application/json Aug 06 14:42:08.429805 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Accept-Encoding: identity Aug 06 14:42:08.429805 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Connection: close Aug 06 14:42:08.429805 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Content-Length: 0 Aug 06 14:42:08.429805 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Content-Type: application/json Aug 06 14:42:08.429805 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Host: 10.222.0.17 Aug 06 14:42:08.429805 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Openstack-System-Scope: None Aug 06 14:42:08.429805 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: User-Agent: python-urllib3/1.26.11 Aug 06 14:42:08.429805 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Auth-Token: gAAAAABi7n2n39i7wTp_6toFl4CELXFfClXR_l2ToyGA0FVNad9Ce93GZHWolkBzKA97aPkBD3XMpsrbGl5giqDQsQknX-7iqrB1la0KWion9hprZ4WuNXuSmM7GBVGv68It-c_E1UKAmC9JOM0KAlbfi-suKLA2kDqVlkdEK_QJdrSg850JumQ Aug 06 14:42:08.429805 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Domain-Id: None Aug 06 14:42:08.429805 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Domain-Name: None Aug 06 14:42:08.429805 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Identity-Status: Confirmed Aug 06 14:42:08.429805 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Is-Admin-Project: True Aug 06 14:42:08.429805 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Domain-Id: default Aug 06 14:42:08.429805 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Domain-Name: Default Aug 06 14:42:08.429805 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Id: 4bd221dfff634404a071ad30db96b99d Aug 06 14:42:08.429805 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Name: tempest-VolumesActionsTest-119308523 Aug 06 14:42:08.429805 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Role: member,reader Aug 06 14:42:08.429805 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Roles: member,reader Aug 06 14:42:08.431530 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4bd221dfff634404a071ad30db96b99d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4bd221dfff634404a071ad30db96b99d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4bd221dfff634404a071ad30db96b99d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4bd221dfff634404a071ad30db96b99d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 06 14:42:08.431530 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Tenant: tempest-VolumesActionsTest-119308523 Aug 06 14:42:08.431530 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Tenant-Id: 4bd221dfff634404a071ad30db96b99d Aug 06 14:42:08.431530 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Tenant-Name: tempest-VolumesActionsTest-119308523 Aug 06 14:42:08.431530 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User: tempest-VolumesActionsTest-119308523-project Aug 06 14:42:08.431530 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Domain-Id: default Aug 06 14:42:08.431530 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Domain-Name: Default Aug 06 14:42:08.431530 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Id: 418f616114fa430cbc73d8cbe3263c52 Aug 06 14:42:08.431530 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Name: tempest-VolumesActionsTest-119308523-project Aug 06 14:42:08.431530 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: method: > Aug 06 14:42:08.431530 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: exception: Instance 5e670c47-e74e-4764-bda3-2c4e26e6e4bc could not be found. Aug 06 14:42:08.431530 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: action_args: {'id': '5e670c47-e74e-4764-bda3-2c4e26e6e4bc'} Aug 06 14:42:08.432554 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 14:42:08.432554 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:42:08.432554 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 14:42:08.432554 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 14:42:08.432554 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 14:42:08.432554 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 14:42:08.432554 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 14:42:08.432554 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 14:42:08.432554 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 14:42:08.432554 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 14:42:08.432554 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e670c47-e74e-4764-bda3-2c4e26e6e4bc could not be found. Aug 06 14:42:08.432554 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:42:08.432554 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:42:08.432554 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:42:08.432554 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:42:08.432554 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:42:08.432554 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:42:08.432554 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 14:42:08.432554 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 14:42:08.432554 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 14:42:08.434439 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 14:42:08.434439 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 14:42:08.434439 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 14:42:08.434439 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 14:42:08.434439 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 14:42:08.434439 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 14:42:08.434439 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 14:42:08.434439 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e670c47-e74e-4764-bda3-2c4e26e6e4bc could not be found. Aug 06 14:42:08.434439 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:42:08.434439 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:42:08.434439 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:42:08.434439 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:42:08.434439 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:42:08.434439 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:42:08.434439 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 14:42:08.434439 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 14:42:08.434439 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e670c47-e74e-4764-bda3-2c4e26e6e4bc could not be found. Aug 06 14:42:08.434439 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:42:08.435798 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-5a69be46-a1a8-4db3-bd53-61d8e112a00b tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Returning 404 to user: Instance 5e670c47-e74e-4764-bda3-2c4e26e6e4bc could not be found. {{(pid=117838) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 14:42:08.435798 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-5a69be46-a1a8-4db3-bd53-61d8e112a00b tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] 10.222.0.17 "GET /compute/v2.1/servers/5e670c47-e74e-4764-bda3-2c4e26e6e4bc" status: 404 len: 111 microversion: 2.1 time: 0.031311 Aug 06 14:42:08.435798 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 517/1082] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:42:08 2022] GET /compute/v2.1/servers/5e670c47-e74e-4764-bda3-2c4e26e6e4bc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 14:42:08.535329 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-24c729e6-2fbc-4922-9f87-47146a5c7cff tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-522418850", "imageRef": "13d7ee60-c9c3-43ee-9861-a9192a114a77", "flavorRef": "452", "networks": [{"uuid": "58ce13ba-43d4-4fc4-a0de-8643109e23aa"}]}} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:42:08.595640 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.network.neutron [None req-24c729e6-2fbc-4922-9f87-47146a5c7cff tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] validate_networks() for [('58ce13ba-43d4-4fc4-a0de-8643109e23aa', None, None, None, None, None)] {{(pid=117837) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 14:42:08.950159 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.virt.hardware [None req-24c729e6-2fbc-4922-9f87-47146a5c7cff tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Flavor limits 0:0:0 {{(pid=117837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 14:42:08.950578 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.virt.hardware [None req-24c729e6-2fbc-4922-9f87-47146a5c7cff tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Image limits 0:0:0 {{(pid=117837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 14:42:08.951110 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.virt.hardware [None req-24c729e6-2fbc-4922-9f87-47146a5c7cff tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Flavor pref 0:0:0 {{(pid=117837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 14:42:08.951530 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.virt.hardware [None req-24c729e6-2fbc-4922-9f87-47146a5c7cff tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Image pref 0:0:0 {{(pid=117837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 14:42:08.951934 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.virt.hardware [None req-24c729e6-2fbc-4922-9f87-47146a5c7cff tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 14:42:08.960723 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-24c729e6-2fbc-4922-9f87-47146a5c7cff tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:42:08.961152 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-24c729e6-2fbc-4922-9f87-47146a5c7cff tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:42:08.961593 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-24c729e6-2fbc-4922-9f87-47146a5c7cff tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:42:08.962313 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-24c729e6-2fbc-4922-9f87-47146a5c7cff tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:42:08.962762 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-24c729e6-2fbc-4922-9f87-47146a5c7cff tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:42:08.963216 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-24c729e6-2fbc-4922-9f87-47146a5c7cff tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:42:08.979311 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.quota [None req-24c729e6-2fbc-4922-9f87-47146a5c7cff tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Getting quotas for project 4bd221dfff634404a071ad30db96b99d. Resources: {'cores', 'instances', 'ram'} {{(pid=117837) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 14:42:08.983254 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.quota [None req-24c729e6-2fbc-4922-9f87-47146a5c7cff tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Getting quotas for user 418f616114fa430cbc73d8cbe3263c52 and project 4bd221dfff634404a071ad30db96b99d. Resources: {'cores', 'instances', 'ram'} {{(pid=117837) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 14:42:08.994371 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-24c729e6-2fbc-4922-9f87-47146a5c7cff tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Going to run 1 instances... {{(pid=117837) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 14:42:08.996676 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-24c729e6-2fbc-4922-9f87-47146a5c7cff tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] [instance: 8f84727f-9ed1-48b7-a843-68a8a333e930] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='13d7ee60-c9c3-43ee-9861-a9192a114a77',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117837) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 14:42:09.039974 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-24c729e6-2fbc-4922-9f87-47146a5c7cff tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.510296 Aug 06 14:42:09.040609 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 566/1083] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Aug 6 14:42:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 512 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 14:42:09.051683 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-4a9ebec4-cec9-4906-af66-8e1e916b6669 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:42:09.052293 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-4a9ebec4-cec9-4906-af66-8e1e916b6669 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] [instance: 8f84727f-9ed1-48b7-a843-68a8a333e930] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:42:09.107291 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-4a9ebec4-cec9-4906-af66-8e1e916b6669 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f616114fa430cbc73d8cbe3263c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd221dfff634404a071ad30db96b99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:42:09.114571 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-4a9ebec4-cec9-4906-af66-8e1e916b6669 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] 10.222.0.17 "GET /compute/v2.1/servers/8f84727f-9ed1-48b7-a843-68a8a333e930" status: 200 len: 1213 microversion: 2.1 time: 0.066633 Aug 06 14:42:09.115158 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 518/1084] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:42:09 2022] GET /compute/v2.1/servers/8f84727f-9ed1-48b7-a843-68a8a333e930 => generated 1213 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:42:10.136062 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-a2f29723-cbf6-4011-9c2a-2bcc2bf393e5 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:42:10.136626 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-a2f29723-cbf6-4011-9c2a-2bcc2bf393e5 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] [instance: 8f84727f-9ed1-48b7-a843-68a8a333e930] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:42:10.144044 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a2f29723-cbf6-4011-9c2a-2bcc2bf393e5 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:42:10.144606 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a2f29723-cbf6-4011-9c2a-2bcc2bf393e5 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:42:10.145106 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a2f29723-cbf6-4011-9c2a-2bcc2bf393e5 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:42:10.145863 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a2f29723-cbf6-4011-9c2a-2bcc2bf393e5 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:42:10.146381 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a2f29723-cbf6-4011-9c2a-2bcc2bf393e5 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:42:10.146898 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a2f29723-cbf6-4011-9c2a-2bcc2bf393e5 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:42:10.245815 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-a2f29723-cbf6-4011-9c2a-2bcc2bf393e5 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f616114fa430cbc73d8cbe3263c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd221dfff634404a071ad30db96b99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:42:10.254446 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-a2f29723-cbf6-4011-9c2a-2bcc2bf393e5 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] 10.222.0.17 "GET /compute/v2.1/servers/8f84727f-9ed1-48b7-a843-68a8a333e930" status: 200 len: 1283 microversion: 2.1 time: 0.123401 Aug 06 14:42:10.255145 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 567/1085] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:42:10 2022] GET /compute/v2.1/servers/8f84727f-9ed1-48b7-a843-68a8a333e930 => generated 1283 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:42:11.275925 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-22da29ce-163b-4746-bbed-bb5cb7c4500e tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:42:11.276541 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-22da29ce-163b-4746-bbed-bb5cb7c4500e tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] [instance: 8f84727f-9ed1-48b7-a843-68a8a333e930] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:42:11.286490 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-22da29ce-163b-4746-bbed-bb5cb7c4500e tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:42:11.288393 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-22da29ce-163b-4746-bbed-bb5cb7c4500e tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:42:11.288393 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-22da29ce-163b-4746-bbed-bb5cb7c4500e tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:42:11.288756 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-22da29ce-163b-4746-bbed-bb5cb7c4500e tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:42:11.289612 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-22da29ce-163b-4746-bbed-bb5cb7c4500e tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:42:11.289612 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-22da29ce-163b-4746-bbed-bb5cb7c4500e tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:42:11.420889 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-22da29ce-163b-4746-bbed-bb5cb7c4500e tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f616114fa430cbc73d8cbe3263c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd221dfff634404a071ad30db96b99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:42:11.428283 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-22da29ce-163b-4746-bbed-bb5cb7c4500e tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] 10.222.0.17 "GET /compute/v2.1/servers/8f84727f-9ed1-48b7-a843-68a8a333e930" status: 200 len: 1313 microversion: 2.1 time: 0.156408 Aug 06 14:42:11.428841 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 519/1086] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:42:11 2022] GET /compute/v2.1/servers/8f84727f-9ed1-48b7-a843-68a8a333e930 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:42:11.473120 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [req-c3c128ee-bf49-4442-a922-f5dd98c6a117 req-d38ee9d4-2118-4e7a-81d5-f9b83d9dff8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f84727f-9ed1-48b7-a843-68a8a333e930", "tag": "8322d448-aa7b-49a4-8188-6a31b9302aed"}]} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:42:11.484401 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-c3c128ee-bf49-4442-a922-f5dd98c6a117 req-d38ee9d4-2118-4e7a-81d5-f9b83d9dff8c service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:42:11.484700 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-c3c128ee-bf49-4442-a922-f5dd98c6a117 req-d38ee9d4-2118-4e7a-81d5-f9b83d9dff8c service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:42:11.485176 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-c3c128ee-bf49-4442-a922-f5dd98c6a117 req-d38ee9d4-2118-4e7a-81d5-f9b83d9dff8c service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:42:11.497029 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.compute.server_external_events [req-c3c128ee-bf49-4442-a922-f5dd98c6a117 req-d38ee9d4-2118-4e7a-81d5-f9b83d9dff8c service nova] Creating event network-changed:8322d448-aa7b-49a4-8188-6a31b9302aed for instance 8f84727f-9ed1-48b7-a843-68a8a333e930 on hv-cinder-85199 Aug 06 14:42:11.503656 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [req-c3c128ee-bf49-4442-a922-f5dd98c6a117 req-d38ee9d4-2118-4e7a-81d5-f9b83d9dff8c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034531 Aug 06 14:42:11.504985 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 568/1087] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 14:42:12.449678 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-6ec51fc1-acc1-46e5-a253-90bcfc8e6752 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:42:12.450286 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-6ec51fc1-acc1-46e5-a253-90bcfc8e6752 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] [instance: 8f84727f-9ed1-48b7-a843-68a8a333e930] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:42:12.457255 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6ec51fc1-acc1-46e5-a253-90bcfc8e6752 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:42:12.457736 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6ec51fc1-acc1-46e5-a253-90bcfc8e6752 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:42:12.458167 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6ec51fc1-acc1-46e5-a253-90bcfc8e6752 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:42:12.458850 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6ec51fc1-acc1-46e5-a253-90bcfc8e6752 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:42:12.459326 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6ec51fc1-acc1-46e5-a253-90bcfc8e6752 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:42:12.459750 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6ec51fc1-acc1-46e5-a253-90bcfc8e6752 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:42:12.588239 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-6ec51fc1-acc1-46e5-a253-90bcfc8e6752 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f616114fa430cbc73d8cbe3263c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd221dfff634404a071ad30db96b99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:42:12.596231 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-6ec51fc1-acc1-46e5-a253-90bcfc8e6752 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] 10.222.0.17 "GET /compute/v2.1/servers/8f84727f-9ed1-48b7-a843-68a8a333e930" status: 200 len: 1313 microversion: 2.1 time: 0.150412 Aug 06 14:42:12.596788 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 520/1088] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:42:12 2022] GET /compute/v2.1/servers/8f84727f-9ed1-48b7-a843-68a8a333e930 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:42:13.617377 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-2fe0d2e1-fc26-44a0-9a06-5bbf98c412b2 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:42:13.618070 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-2fe0d2e1-fc26-44a0-9a06-5bbf98c412b2 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] [instance: 8f84727f-9ed1-48b7-a843-68a8a333e930] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:42:13.624682 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2fe0d2e1-fc26-44a0-9a06-5bbf98c412b2 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:42:13.625154 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2fe0d2e1-fc26-44a0-9a06-5bbf98c412b2 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:42:13.625582 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2fe0d2e1-fc26-44a0-9a06-5bbf98c412b2 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:42:13.626258 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2fe0d2e1-fc26-44a0-9a06-5bbf98c412b2 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:42:13.626703 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2fe0d2e1-fc26-44a0-9a06-5bbf98c412b2 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:42:13.627150 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2fe0d2e1-fc26-44a0-9a06-5bbf98c412b2 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:42:13.757796 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-2fe0d2e1-fc26-44a0-9a06-5bbf98c412b2 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f616114fa430cbc73d8cbe3263c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd221dfff634404a071ad30db96b99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:42:13.765200 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-2fe0d2e1-fc26-44a0-9a06-5bbf98c412b2 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] 10.222.0.17 "GET /compute/v2.1/servers/8f84727f-9ed1-48b7-a843-68a8a333e930" status: 200 len: 1313 microversion: 2.1 time: 0.152045 Aug 06 14:42:13.765757 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 569/1089] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:42:13 2022] GET /compute/v2.1/servers/8f84727f-9ed1-48b7-a843-68a8a333e930 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:42:14.785267 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-8b0aa98c-0456-4589-a14f-64813411d685 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:42:14.785876 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-8b0aa98c-0456-4589-a14f-64813411d685 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] [instance: 8f84727f-9ed1-48b7-a843-68a8a333e930] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:42:14.792282 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8b0aa98c-0456-4589-a14f-64813411d685 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:42:14.792772 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8b0aa98c-0456-4589-a14f-64813411d685 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:42:14.793209 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8b0aa98c-0456-4589-a14f-64813411d685 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:42:14.793892 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8b0aa98c-0456-4589-a14f-64813411d685 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:42:14.794345 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8b0aa98c-0456-4589-a14f-64813411d685 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:42:14.794786 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8b0aa98c-0456-4589-a14f-64813411d685 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:42:14.924848 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-8b0aa98c-0456-4589-a14f-64813411d685 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f616114fa430cbc73d8cbe3263c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd221dfff634404a071ad30db96b99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:42:14.932259 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-8b0aa98c-0456-4589-a14f-64813411d685 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] 10.222.0.17 "GET /compute/v2.1/servers/8f84727f-9ed1-48b7-a843-68a8a333e930" status: 200 len: 1313 microversion: 2.1 time: 0.150862 Aug 06 14:42:14.932817 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 521/1090] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:42:14 2022] GET /compute/v2.1/servers/8f84727f-9ed1-48b7-a843-68a8a333e930 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:42:15.954149 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-8661b1a4-0723-444f-a39e-b5856c6e8614 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:42:15.954753 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-8661b1a4-0723-444f-a39e-b5856c6e8614 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] [instance: 8f84727f-9ed1-48b7-a843-68a8a333e930] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:42:15.961614 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8661b1a4-0723-444f-a39e-b5856c6e8614 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:42:15.962090 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8661b1a4-0723-444f-a39e-b5856c6e8614 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:42:15.962521 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8661b1a4-0723-444f-a39e-b5856c6e8614 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:42:15.963292 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8661b1a4-0723-444f-a39e-b5856c6e8614 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:42:15.963851 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8661b1a4-0723-444f-a39e-b5856c6e8614 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:42:15.964370 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8661b1a4-0723-444f-a39e-b5856c6e8614 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:42:16.097859 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-8661b1a4-0723-444f-a39e-b5856c6e8614 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f616114fa430cbc73d8cbe3263c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd221dfff634404a071ad30db96b99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:42:16.105283 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-8661b1a4-0723-444f-a39e-b5856c6e8614 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] 10.222.0.17 "GET /compute/v2.1/servers/8f84727f-9ed1-48b7-a843-68a8a333e930" status: 200 len: 1313 microversion: 2.1 time: 0.155729 Aug 06 14:42:16.105774 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 570/1091] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:42:15 2022] GET /compute/v2.1/servers/8f84727f-9ed1-48b7-a843-68a8a333e930 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:42:17.125669 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-b095450a-692b-4263-ae8b-abcd56772563 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:42:17.126195 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-b095450a-692b-4263-ae8b-abcd56772563 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] [instance: 8f84727f-9ed1-48b7-a843-68a8a333e930] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:42:17.132624 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b095450a-692b-4263-ae8b-abcd56772563 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:42:17.133098 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b095450a-692b-4263-ae8b-abcd56772563 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:42:17.133526 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b095450a-692b-4263-ae8b-abcd56772563 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:42:17.134209 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b095450a-692b-4263-ae8b-abcd56772563 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:42:17.134658 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b095450a-692b-4263-ae8b-abcd56772563 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:42:17.135109 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b095450a-692b-4263-ae8b-abcd56772563 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:42:17.261581 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-b095450a-692b-4263-ae8b-abcd56772563 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f616114fa430cbc73d8cbe3263c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd221dfff634404a071ad30db96b99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:42:17.269441 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-b095450a-692b-4263-ae8b-abcd56772563 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] 10.222.0.17 "GET /compute/v2.1/servers/8f84727f-9ed1-48b7-a843-68a8a333e930" status: 200 len: 1313 microversion: 2.1 time: 0.147785 Aug 06 14:42:17.269999 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 522/1092] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:42:17 2022] GET /compute/v2.1/servers/8f84727f-9ed1-48b7-a843-68a8a333e930 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:42:18.290312 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-96b88714-e643-4830-b7e8-089d7e76ae21 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:42:18.290951 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-96b88714-e643-4830-b7e8-089d7e76ae21 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] [instance: 8f84727f-9ed1-48b7-a843-68a8a333e930] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:42:18.293333 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:42:18.299399 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-96b88714-e643-4830-b7e8-089d7e76ae21 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:42:18.299885 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-96b88714-e643-4830-b7e8-089d7e76ae21 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:42:18.300315 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-96b88714-e643-4830-b7e8-089d7e76ae21 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:42:18.300997 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-96b88714-e643-4830-b7e8-089d7e76ae21 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:42:18.301446 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-96b88714-e643-4830-b7e8-089d7e76ae21 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:42:18.301891 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-96b88714-e643-4830-b7e8-089d7e76ae21 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:42:18.306303 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:42:18.434586 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-96b88714-e643-4830-b7e8-089d7e76ae21 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f616114fa430cbc73d8cbe3263c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd221dfff634404a071ad30db96b99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:42:18.442413 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-96b88714-e643-4830-b7e8-089d7e76ae21 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] 10.222.0.17 "GET /compute/v2.1/servers/8f84727f-9ed1-48b7-a843-68a8a333e930" status: 200 len: 1313 microversion: 2.1 time: 0.155979 Aug 06 14:42:18.442979 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 571/1093] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:42:18 2022] GET /compute/v2.1/servers/8f84727f-9ed1-48b7-a843-68a8a333e930 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:42:19.463762 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-e5be2b48-c7aa-4e8d-a743-30cdfda85a7f tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:42:19.464361 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-e5be2b48-c7aa-4e8d-a743-30cdfda85a7f tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] [instance: 8f84727f-9ed1-48b7-a843-68a8a333e930] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:42:19.466634 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_cell0:SELECT=2 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:42:19.471943 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e5be2b48-c7aa-4e8d-a743-30cdfda85a7f tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:42:19.472420 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e5be2b48-c7aa-4e8d-a743-30cdfda85a7f tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:42:19.472846 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e5be2b48-c7aa-4e8d-a743-30cdfda85a7f tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:42:19.473521 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e5be2b48-c7aa-4e8d-a743-30cdfda85a7f tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:42:19.473967 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e5be2b48-c7aa-4e8d-a743-30cdfda85a7f tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:42:19.474383 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e5be2b48-c7aa-4e8d-a743-30cdfda85a7f tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:42:19.604381 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-e5be2b48-c7aa-4e8d-a743-30cdfda85a7f tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f616114fa430cbc73d8cbe3263c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd221dfff634404a071ad30db96b99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:42:19.606549 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_cell1:SELECT=85 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:42:19.614892 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-e5be2b48-c7aa-4e8d-a743-30cdfda85a7f tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] 10.222.0.17 "GET /compute/v2.1/servers/8f84727f-9ed1-48b7-a843-68a8a333e930" status: 200 len: 1313 microversion: 2.1 time: 0.155097 Aug 06 14:42:19.615452 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 523/1094] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:42:19 2022] GET /compute/v2.1/servers/8f84727f-9ed1-48b7-a843-68a8a333e930 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:42:20.635453 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-18b9fe30-7149-4320-8a91-f64957a43525 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:42:20.636066 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-18b9fe30-7149-4320-8a91-f64957a43525 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] [instance: 8f84727f-9ed1-48b7-a843-68a8a333e930] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:42:20.638034 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_cell0:SELECT=2 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:42:20.638849 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_cell0:SELECT=6 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:42:20.645719 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-18b9fe30-7149-4320-8a91-f64957a43525 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:42:20.646198 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-18b9fe30-7149-4320-8a91-f64957a43525 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:42:20.646627 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-18b9fe30-7149-4320-8a91-f64957a43525 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:42:20.647550 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-18b9fe30-7149-4320-8a91-f64957a43525 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:42:20.647998 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-18b9fe30-7149-4320-8a91-f64957a43525 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:42:20.648415 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-18b9fe30-7149-4320-8a91-f64957a43525 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:42:20.782526 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-18b9fe30-7149-4320-8a91-f64957a43525 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f616114fa430cbc73d8cbe3263c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd221dfff634404a071ad30db96b99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:42:20.789977 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-18b9fe30-7149-4320-8a91-f64957a43525 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] 10.222.0.17 "GET /compute/v2.1/servers/8f84727f-9ed1-48b7-a843-68a8a333e930" status: 200 len: 1313 microversion: 2.1 time: 0.158727 Aug 06 14:42:20.790536 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 572/1095] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:42:20 2022] GET /compute/v2.1/servers/8f84727f-9ed1-48b7-a843-68a8a333e930 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:42:21.811273 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-24a4202a-99df-4968-8d9f-bd5b93e88103 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:42:21.811877 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-24a4202a-99df-4968-8d9f-bd5b93e88103 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] [instance: 8f84727f-9ed1-48b7-a843-68a8a333e930] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:42:21.814212 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_api:SELECT=39 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:42:21.819454 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-24a4202a-99df-4968-8d9f-bd5b93e88103 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:42:21.819960 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-24a4202a-99df-4968-8d9f-bd5b93e88103 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:42:21.820389 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-24a4202a-99df-4968-8d9f-bd5b93e88103 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:42:21.821092 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-24a4202a-99df-4968-8d9f-bd5b93e88103 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:42:21.821540 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-24a4202a-99df-4968-8d9f-bd5b93e88103 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:42:21.821956 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-24a4202a-99df-4968-8d9f-bd5b93e88103 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:42:21.947269 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-24a4202a-99df-4968-8d9f-bd5b93e88103 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f616114fa430cbc73d8cbe3263c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd221dfff634404a071ad30db96b99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:42:21.955328 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-24a4202a-99df-4968-8d9f-bd5b93e88103 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] 10.222.0.17 "GET /compute/v2.1/servers/8f84727f-9ed1-48b7-a843-68a8a333e930" status: 200 len: 1313 microversion: 2.1 time: 0.148351 Aug 06 14:42:21.955888 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 524/1096] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:42:21 2022] GET /compute/v2.1/servers/8f84727f-9ed1-48b7-a843-68a8a333e930 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:42:22.975486 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-d508becf-e64a-457b-9fdc-004992f08279 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:42:22.976094 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-d508becf-e64a-457b-9fdc-004992f08279 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] [instance: 8f84727f-9ed1-48b7-a843-68a8a333e930] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:42:22.982377 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d508becf-e64a-457b-9fdc-004992f08279 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:42:22.982850 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d508becf-e64a-457b-9fdc-004992f08279 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:42:22.983307 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d508becf-e64a-457b-9fdc-004992f08279 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:42:22.983987 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d508becf-e64a-457b-9fdc-004992f08279 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:42:22.984435 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d508becf-e64a-457b-9fdc-004992f08279 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:42:22.984849 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d508becf-e64a-457b-9fdc-004992f08279 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:42:23.112616 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-d508becf-e64a-457b-9fdc-004992f08279 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f616114fa430cbc73d8cbe3263c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd221dfff634404a071ad30db96b99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:42:23.119882 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-d508becf-e64a-457b-9fdc-004992f08279 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] 10.222.0.17 "GET /compute/v2.1/servers/8f84727f-9ed1-48b7-a843-68a8a333e930" status: 200 len: 1313 microversion: 2.1 time: 0.148229 Aug 06 14:42:23.120437 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 573/1097] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:42:22 2022] GET /compute/v2.1/servers/8f84727f-9ed1-48b7-a843-68a8a333e930 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:42:24.139765 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-cd21ee46-62cb-4e1f-9de6-6dbd080ff44e tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:42:24.140378 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-cd21ee46-62cb-4e1f-9de6-6dbd080ff44e tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] [instance: 8f84727f-9ed1-48b7-a843-68a8a333e930] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:42:24.146789 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-cd21ee46-62cb-4e1f-9de6-6dbd080ff44e tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:42:24.147298 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-cd21ee46-62cb-4e1f-9de6-6dbd080ff44e tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:42:24.147728 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-cd21ee46-62cb-4e1f-9de6-6dbd080ff44e tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:42:24.148409 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-cd21ee46-62cb-4e1f-9de6-6dbd080ff44e tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:42:24.148856 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-cd21ee46-62cb-4e1f-9de6-6dbd080ff44e tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:42:24.149276 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-cd21ee46-62cb-4e1f-9de6-6dbd080ff44e tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:42:24.288255 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-cd21ee46-62cb-4e1f-9de6-6dbd080ff44e tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f616114fa430cbc73d8cbe3263c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd221dfff634404a071ad30db96b99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:42:24.295821 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-cd21ee46-62cb-4e1f-9de6-6dbd080ff44e tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] 10.222.0.17 "GET /compute/v2.1/servers/8f84727f-9ed1-48b7-a843-68a8a333e930" status: 200 len: 1313 microversion: 2.1 time: 0.160031 Aug 06 14:42:24.297044 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 525/1098] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:42:24 2022] GET /compute/v2.1/servers/8f84727f-9ed1-48b7-a843-68a8a333e930 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:42:24.573906 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [req-79663682-c03d-4b0c-9005-8beab2bc82a3 req-476060d5-4888-42b3-a333-a947e5cfc303 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f84727f-9ed1-48b7-a843-68a8a333e930", "name": "network-vif-plugged", "status": "completed", "tag": "8322d448-aa7b-49a4-8188-6a31b9302aed"}]} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:42:24.585217 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-79663682-c03d-4b0c-9005-8beab2bc82a3 req-476060d5-4888-42b3-a333-a947e5cfc303 service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:42:24.585718 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-79663682-c03d-4b0c-9005-8beab2bc82a3 req-476060d5-4888-42b3-a333-a947e5cfc303 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:42:24.586174 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-79663682-c03d-4b0c-9005-8beab2bc82a3 req-476060d5-4888-42b3-a333-a947e5cfc303 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:42:24.598709 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.compute.server_external_events [req-79663682-c03d-4b0c-9005-8beab2bc82a3 req-476060d5-4888-42b3-a333-a947e5cfc303 service nova] Creating event network-vif-plugged:8322d448-aa7b-49a4-8188-6a31b9302aed for instance 8f84727f-9ed1-48b7-a843-68a8a333e930 on hv-cinder-85199 Aug 06 14:42:24.603825 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [req-79663682-c03d-4b0c-9005-8beab2bc82a3 req-476060d5-4888-42b3-a333-a947e5cfc303 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033660 Aug 06 14:42:24.604435 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 574/1099] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 14:42:25.317034 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-99323a10-8262-4542-bebc-6bd6fe4b4880 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:42:25.317631 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-99323a10-8262-4542-bebc-6bd6fe4b4880 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] [instance: 8f84727f-9ed1-48b7-a843-68a8a333e930] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:42:25.324218 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-99323a10-8262-4542-bebc-6bd6fe4b4880 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:42:25.324698 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-99323a10-8262-4542-bebc-6bd6fe4b4880 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:42:25.325131 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-99323a10-8262-4542-bebc-6bd6fe4b4880 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:42:25.325827 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-99323a10-8262-4542-bebc-6bd6fe4b4880 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:42:25.326282 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-99323a10-8262-4542-bebc-6bd6fe4b4880 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:42:25.326703 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-99323a10-8262-4542-bebc-6bd6fe4b4880 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:42:25.459504 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-99323a10-8262-4542-bebc-6bd6fe4b4880 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f616114fa430cbc73d8cbe3263c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd221dfff634404a071ad30db96b99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:42:25.467083 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-99323a10-8262-4542-bebc-6bd6fe4b4880 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] 10.222.0.17 "GET /compute/v2.1/servers/8f84727f-9ed1-48b7-a843-68a8a333e930" status: 200 len: 1313 microversion: 2.1 time: 0.153905 Aug 06 14:42:25.467648 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 526/1100] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:42:25 2022] GET /compute/v2.1/servers/8f84727f-9ed1-48b7-a843-68a8a333e930 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:42:26.488402 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-64df15c0-2b12-408e-ae22-1a1dac0199d3 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:42:26.489021 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-64df15c0-2b12-408e-ae22-1a1dac0199d3 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] [instance: 8f84727f-9ed1-48b7-a843-68a8a333e930] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:42:26.495071 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-64df15c0-2b12-408e-ae22-1a1dac0199d3 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:42:26.495543 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-64df15c0-2b12-408e-ae22-1a1dac0199d3 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:42:26.495971 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-64df15c0-2b12-408e-ae22-1a1dac0199d3 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:42:26.496647 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-64df15c0-2b12-408e-ae22-1a1dac0199d3 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:42:26.497095 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-64df15c0-2b12-408e-ae22-1a1dac0199d3 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:42:26.497510 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-64df15c0-2b12-408e-ae22-1a1dac0199d3 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:42:26.631764 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-64df15c0-2b12-408e-ae22-1a1dac0199d3 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f616114fa430cbc73d8cbe3263c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd221dfff634404a071ad30db96b99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:42:26.640673 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-64df15c0-2b12-408e-ae22-1a1dac0199d3 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] 10.222.0.17 "GET /compute/v2.1/servers/8f84727f-9ed1-48b7-a843-68a8a333e930" status: 200 len: 1313 microversion: 2.1 time: 0.156450 Aug 06 14:42:26.641244 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 575/1101] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:42:26 2022] GET /compute/v2.1/servers/8f84727f-9ed1-48b7-a843-68a8a333e930 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:42:27.661500 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-12b05bcd-ebf9-495c-9f80-2e7cfec2e01d tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:42:27.662110 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-12b05bcd-ebf9-495c-9f80-2e7cfec2e01d tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] [instance: 8f84727f-9ed1-48b7-a843-68a8a333e930] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:42:27.668493 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-12b05bcd-ebf9-495c-9f80-2e7cfec2e01d tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:42:27.668976 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-12b05bcd-ebf9-495c-9f80-2e7cfec2e01d tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:42:27.669408 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-12b05bcd-ebf9-495c-9f80-2e7cfec2e01d tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:42:27.670090 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-12b05bcd-ebf9-495c-9f80-2e7cfec2e01d tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:42:27.670548 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-12b05bcd-ebf9-495c-9f80-2e7cfec2e01d tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:42:27.671000 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-12b05bcd-ebf9-495c-9f80-2e7cfec2e01d tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:42:27.803871 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-12b05bcd-ebf9-495c-9f80-2e7cfec2e01d tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f616114fa430cbc73d8cbe3263c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd221dfff634404a071ad30db96b99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:42:27.812071 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-12b05bcd-ebf9-495c-9f80-2e7cfec2e01d tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] 10.222.0.17 "GET /compute/v2.1/servers/8f84727f-9ed1-48b7-a843-68a8a333e930" status: 200 len: 1496 microversion: 2.1 time: 0.154450 Aug 06 14:42:27.812648 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 527/1102] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:42:27 2022] GET /compute/v2.1/servers/8f84727f-9ed1-48b7-a843-68a8a333e930 => generated 1496 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:42:28.380652 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-6ece517c-3097-4f3e-b670-6fdd1282fe26 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:42:28.381128 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-6ece517c-3097-4f3e-b670-6fdd1282fe26 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] [instance: 8f84727f-9ed1-48b7-a843-68a8a333e930] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:42:28.387535 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6ece517c-3097-4f3e-b670-6fdd1282fe26 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:42:28.388010 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6ece517c-3097-4f3e-b670-6fdd1282fe26 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:42:28.388470 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6ece517c-3097-4f3e-b670-6fdd1282fe26 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:42:28.389151 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6ece517c-3097-4f3e-b670-6fdd1282fe26 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:42:28.389599 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6ece517c-3097-4f3e-b670-6fdd1282fe26 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:42:28.390016 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6ece517c-3097-4f3e-b670-6fdd1282fe26 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:42:28.414007 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-6ece517c-3097-4f3e-b670-6fdd1282fe26 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] [instance: 8f84727f-9ed1-48b7-a843-68a8a333e930] Going to try to terminate instance {{(pid=117837) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 14:42:28.490275 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-6ece517c-3097-4f3e-b670-6fdd1282fe26 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] 10.222.0.17 "DELETE /compute/v2.1/servers/8f84727f-9ed1-48b7-a843-68a8a333e930" status: 204 len: 0 microversion: 2.1 time: 0.113156 Aug 06 14:42:28.491040 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 576/1103] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Aug 6 14:42:28 2022] DELETE /compute/v2.1/servers/8f84727f-9ed1-48b7-a843-68a8a333e930 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 14:42:28.500389 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-f81c14f4-cd40-4e8a-8186-9ee07492a02f tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:42:28.501025 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-f81c14f4-cd40-4e8a-8186-9ee07492a02f tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] [instance: 8f84727f-9ed1-48b7-a843-68a8a333e930] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:42:28.506844 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f81c14f4-cd40-4e8a-8186-9ee07492a02f tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:42:28.507355 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f81c14f4-cd40-4e8a-8186-9ee07492a02f tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:42:28.507787 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f81c14f4-cd40-4e8a-8186-9ee07492a02f tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:42:28.508474 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f81c14f4-cd40-4e8a-8186-9ee07492a02f tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:42:28.508926 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f81c14f4-cd40-4e8a-8186-9ee07492a02f tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:42:28.509351 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f81c14f4-cd40-4e8a-8186-9ee07492a02f tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:42:28.883370 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-f81c14f4-cd40-4e8a-8186-9ee07492a02f tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f616114fa430cbc73d8cbe3263c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd221dfff634404a071ad30db96b99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:42:28.891350 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-f81c14f4-cd40-4e8a-8186-9ee07492a02f tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] 10.222.0.17 "GET /compute/v2.1/servers/8f84727f-9ed1-48b7-a843-68a8a333e930" status: 200 len: 1502 microversion: 2.1 time: 0.395625 Aug 06 14:42:28.891910 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 528/1104] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:42:28 2022] GET /compute/v2.1/servers/8f84727f-9ed1-48b7-a843-68a8a333e930 => generated 1502 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:42:29.913055 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-f931f905-9e15-441c-b973-f6be8f093a04 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:42:29.913748 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-f931f905-9e15-441c-b973-f6be8f093a04 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] [instance: 8f84727f-9ed1-48b7-a843-68a8a333e930] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:42:29.920134 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f931f905-9e15-441c-b973-f6be8f093a04 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:42:29.920610 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f931f905-9e15-441c-b973-f6be8f093a04 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:42:29.921542 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f931f905-9e15-441c-b973-f6be8f093a04 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:42:29.922223 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f931f905-9e15-441c-b973-f6be8f093a04 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:42:29.922670 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f931f905-9e15-441c-b973-f6be8f093a04 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:42:29.923112 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f931f905-9e15-441c-b973-f6be8f093a04 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:42:30.054644 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-f931f905-9e15-441c-b973-f6be8f093a04 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f616114fa430cbc73d8cbe3263c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd221dfff634404a071ad30db96b99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:42:30.063452 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-f931f905-9e15-441c-b973-f6be8f093a04 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] 10.222.0.17 "GET /compute/v2.1/servers/8f84727f-9ed1-48b7-a843-68a8a333e930" status: 200 len: 1502 microversion: 2.1 time: 0.154577 Aug 06 14:42:30.064020 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 577/1105] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:42:29 2022] GET /compute/v2.1/servers/8f84727f-9ed1-48b7-a843-68a8a333e930 => generated 1502 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:42:30.834541 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [req-69c590e0-dc2f-4234-9af1-bfa343c07727 req-66b57bb7-4201-4167-82f2-0f811dc48e61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f84727f-9ed1-48b7-a843-68a8a333e930", "name": "network-vif-deleted", "tag": "8322d448-aa7b-49a4-8188-6a31b9302aed"}]} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:42:30.850058 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-69c590e0-dc2f-4234-9af1-bfa343c07727 req-66b57bb7-4201-4167-82f2-0f811dc48e61 service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:42:30.851366 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-69c590e0-dc2f-4234-9af1-bfa343c07727 req-66b57bb7-4201-4167-82f2-0f811dc48e61 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:42:30.852038 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-69c590e0-dc2f-4234-9af1-bfa343c07727 req-66b57bb7-4201-4167-82f2-0f811dc48e61 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:42:30.880842 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.compute.server_external_events [req-69c590e0-dc2f-4234-9af1-bfa343c07727 req-66b57bb7-4201-4167-82f2-0f811dc48e61 service nova] Creating event network-vif-deleted:8322d448-aa7b-49a4-8188-6a31b9302aed for instance 8f84727f-9ed1-48b7-a843-68a8a333e930 on hv-cinder-85199 Aug 06 14:42:30.886939 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [req-69c590e0-dc2f-4234-9af1-bfa343c07727 req-66b57bb7-4201-4167-82f2-0f811dc48e61 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055691 Aug 06 14:42:30.888110 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 529/1106] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:42:31.084862 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-b8142264-3e4f-4b07-894c-c9f26aab67e0 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:42:31.085554 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-b8142264-3e4f-4b07-894c-c9f26aab67e0 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] [instance: 8f84727f-9ed1-48b7-a843-68a8a333e930] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:42:31.091956 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b8142264-3e4f-4b07-894c-c9f26aab67e0 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:42:31.092432 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b8142264-3e4f-4b07-894c-c9f26aab67e0 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:42:31.092864 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b8142264-3e4f-4b07-894c-c9f26aab67e0 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:42:31.093547 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b8142264-3e4f-4b07-894c-c9f26aab67e0 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:42:31.094000 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b8142264-3e4f-4b07-894c-c9f26aab67e0 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:42:31.094438 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b8142264-3e4f-4b07-894c-c9f26aab67e0 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:42:31.125992 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b8142264-3e4f-4b07-894c-c9f26aab67e0 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:42:31.126472 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b8142264-3e4f-4b07-894c-c9f26aab67e0 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:42:31.126918 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b8142264-3e4f-4b07-894c-c9f26aab67e0 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:42:31.127363 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.objects.instance [None req-b8142264-3e4f-4b07-894c-c9f26aab67e0 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lazy-loading 'fault' on Instance uuid 8f84727f-9ed1-48b7-a843-68a8a333e930 {{(pid=117837) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 14:42:31.171175 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-b8142264-3e4f-4b07-894c-c9f26aab67e0 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f616114fa430cbc73d8cbe3263c52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bd221dfff634404a071ad30db96b99d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:42:31.178526 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-b8142264-3e4f-4b07-894c-c9f26aab67e0 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] 10.222.0.17 "GET /compute/v2.1/servers/8f84727f-9ed1-48b7-a843-68a8a333e930" status: 200 len: 1303 microversion: 2.1 time: 0.097540 Aug 06 14:42:31.179111 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 578/1107] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:42:31 2022] GET /compute/v2.1/servers/8f84727f-9ed1-48b7-a843-68a8a333e930 => generated 1303 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:42:32.201604 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-b20db23e-3755-46c9-a67a-d8fdf11cc541 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:42:32.203149 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-b20db23e-3755-46c9-a67a-d8fdf11cc541 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] [instance: 8f84727f-9ed1-48b7-a843-68a8a333e930] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:42:32.211376 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b20db23e-3755-46c9-a67a-d8fdf11cc541 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:42:32.212146 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b20db23e-3755-46c9-a67a-d8fdf11cc541 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:42:32.212908 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b20db23e-3755-46c9-a67a-d8fdf11cc541 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:42:32.214055 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b20db23e-3755-46c9-a67a-d8fdf11cc541 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:42:32.214531 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b20db23e-3755-46c9-a67a-d8fdf11cc541 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:42:32.215630 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b20db23e-3755-46c9-a67a-d8fdf11cc541 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:42:32.230560 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.wsgi [None req-b20db23e-3755-46c9-a67a-d8fdf11cc541 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] HTTP exception thrown: Instance 8f84727f-9ed1-48b7-a843-68a8a333e930 could not be found. Aug 06 14:42:32.232606 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-b20db23e-3755-46c9-a67a-d8fdf11cc541 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Request method failure captured: Aug 06 14:42:32.232606 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: request: GET /compute/v2.1/servers/8f84727f-9ed1-48b7-a843-68a8a333e930 HTTP/1.1 Aug 06 14:42:32.232606 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Accept: application/json Aug 06 14:42:32.232606 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Accept-Encoding: identity Aug 06 14:42:32.232606 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Connection: close Aug 06 14:42:32.232606 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Content-Length: 0 Aug 06 14:42:32.232606 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Content-Type: application/json Aug 06 14:42:32.232606 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Host: 10.222.0.17 Aug 06 14:42:32.232606 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Openstack-System-Scope: None Aug 06 14:42:32.232606 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: User-Agent: python-urllib3/1.26.11 Aug 06 14:42:32.232606 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Auth-Token: gAAAAABi7n2n39i7wTp_6toFl4CELXFfClXR_l2ToyGA0FVNad9Ce93GZHWolkBzKA97aPkBD3XMpsrbGl5giqDQsQknX-7iqrB1la0KWion9hprZ4WuNXuSmM7GBVGv68It-c_E1UKAmC9JOM0KAlbfi-suKLA2kDqVlkdEK_QJdrSg850JumQ Aug 06 14:42:32.232606 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Domain-Id: None Aug 06 14:42:32.232606 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Domain-Name: None Aug 06 14:42:32.232606 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Identity-Status: Confirmed Aug 06 14:42:32.232606 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Is-Admin-Project: True Aug 06 14:42:32.232606 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Domain-Id: default Aug 06 14:42:32.232606 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Domain-Name: Default Aug 06 14:42:32.232606 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Id: 4bd221dfff634404a071ad30db96b99d Aug 06 14:42:32.232606 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Name: tempest-VolumesActionsTest-119308523 Aug 06 14:42:32.232606 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Role: member,reader Aug 06 14:42:32.232606 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Roles: member,reader Aug 06 14:42:32.234460 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4bd221dfff634404a071ad30db96b99d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/4bd221dfff634404a071ad30db96b99d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_4bd221dfff634404a071ad30db96b99d", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/4bd221dfff634404a071ad30db96b99d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 06 14:42:32.234460 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Tenant: tempest-VolumesActionsTest-119308523 Aug 06 14:42:32.234460 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Tenant-Id: 4bd221dfff634404a071ad30db96b99d Aug 06 14:42:32.234460 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Tenant-Name: tempest-VolumesActionsTest-119308523 Aug 06 14:42:32.234460 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User: tempest-VolumesActionsTest-119308523-project Aug 06 14:42:32.234460 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Domain-Id: default Aug 06 14:42:32.234460 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Domain-Name: Default Aug 06 14:42:32.234460 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Id: 418f616114fa430cbc73d8cbe3263c52 Aug 06 14:42:32.234460 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Name: tempest-VolumesActionsTest-119308523-project Aug 06 14:42:32.234460 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: method: > Aug 06 14:42:32.234460 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: exception: Instance 8f84727f-9ed1-48b7-a843-68a8a333e930 could not be found. Aug 06 14:42:32.234460 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: action_args: {'id': '8f84727f-9ed1-48b7-a843-68a8a333e930'} Aug 06 14:42:32.235476 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 14:42:32.235476 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:42:32.235476 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 14:42:32.235476 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 14:42:32.235476 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 14:42:32.235476 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 14:42:32.235476 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 14:42:32.235476 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 14:42:32.235476 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 14:42:32.235476 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 14:42:32.235476 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f84727f-9ed1-48b7-a843-68a8a333e930 could not be found. Aug 06 14:42:32.235476 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:42:32.235476 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:42:32.235476 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:42:32.235476 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:42:32.235476 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:42:32.235476 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:42:32.235476 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 14:42:32.235476 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 14:42:32.235476 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 14:42:32.237316 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 14:42:32.237316 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 14:42:32.237316 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 14:42:32.237316 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 14:42:32.237316 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 14:42:32.237316 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 14:42:32.237316 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 14:42:32.237316 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f84727f-9ed1-48b7-a843-68a8a333e930 could not be found. Aug 06 14:42:32.237316 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:42:32.237316 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:42:32.237316 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:42:32.237316 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:42:32.237316 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:42:32.237316 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:42:32.237316 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 14:42:32.237316 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 14:42:32.237316 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f84727f-9ed1-48b7-a843-68a8a333e930 could not be found. Aug 06 14:42:32.237316 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:42:32.238764 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-b20db23e-3755-46c9-a67a-d8fdf11cc541 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] Returning 404 to user: Instance 8f84727f-9ed1-48b7-a843-68a8a333e930 could not be found. {{(pid=117838) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 14:42:32.238764 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-b20db23e-3755-46c9-a67a-d8fdf11cc541 tempest-VolumesActionsTest-119308523 tempest-VolumesActionsTest-119308523-project] 10.222.0.17 "GET /compute/v2.1/servers/8f84727f-9ed1-48b7-a843-68a8a333e930" status: 404 len: 111 microversion: 2.1 time: 0.037560 Aug 06 14:42:32.248517 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 530/1108] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:42:32 2022] GET /compute/v2.1/servers/8f84727f-9ed1-48b7-a843-68a8a333e930 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 14:42:41.123314 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:42:41.175431 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:42:41.318612 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-1db7daa7-b48b-4d4e-b6ed-2afb4b78d176 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Action: 'create', calling method: .version_select at 0x7fbab0e2a9d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-581051277", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2Hw+r38FojULPvlKh5x3IyZMOTKHBMejwVoflAhgGFfO3wp0q1BavjHjRSJD9oP2kVLiEB+eM7JKSREHpZ0ii7c3BZH0xLRouAs+2Q2JWsqsqoy3T84O781Z9xCeLKXA=="}} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:42:41.352016 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.quota [None req-1db7daa7-b48b-4d4e-b6ed-2afb4b78d176 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Getting quotas for project 779be602b4054e6389c8ade7752e7ac2. Resources: {'key_pairs'} {{(pid=117837) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 14:42:41.360251 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.quota [None req-1db7daa7-b48b-4d4e-b6ed-2afb4b78d176 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Getting quotas for user 164c1e7ad0a74e68b4f4cc4bb3eef50e and project 779be602b4054e6389c8ade7752e7ac2. Resources: {'key_pairs'} {{(pid=117837) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 14:42:41.409716 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-1db7daa7-b48b-4d4e-b6ed-2afb4b78d176 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.372140 Aug 06 14:42:41.410711 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 579/1109] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Aug 6 14:42:41 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:43:10.214649 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-6e1d81e8-6dc7-4952-bc2d-0f4ee4efdb5e tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1551907369", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-581051277", "security_groups": [{"name": "tempest-secgroup-smoke-1277828138"}], "networks": [{"uuid": "c3ab9e04-915f-452b-a2cb-2fd51667588d"}], "block_device_mapping_v2": [{"uuid": "a0c49b54-6a9f-4ae4-ac4e-eeb08ac02178", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:43:10.225721 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_api:SELECT=13 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:43:10.226480 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_cell1:SELECT=35 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:43:10.418972 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.network.neutron [None req-6e1d81e8-6dc7-4952-bc2d-0f4ee4efdb5e tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] validate_networks() for [('c3ab9e04-915f-452b-a2cb-2fd51667588d', None, None, None, None, None)] {{(pid=117838) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 14:43:11.624301 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.virt.hardware [None req-6e1d81e8-6dc7-4952-bc2d-0f4ee4efdb5e tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Flavor limits 0:0:0 {{(pid=117838) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 14:43:11.626065 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.virt.hardware [None req-6e1d81e8-6dc7-4952-bc2d-0f4ee4efdb5e tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Image limits 0:0:0 {{(pid=117838) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 14:43:11.626741 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.virt.hardware [None req-6e1d81e8-6dc7-4952-bc2d-0f4ee4efdb5e tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Flavor pref 0:0:0 {{(pid=117838) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 14:43:11.627337 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.virt.hardware [None req-6e1d81e8-6dc7-4952-bc2d-0f4ee4efdb5e tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Image pref 0:0:0 {{(pid=117838) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 14:43:11.628072 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.virt.hardware [None req-6e1d81e8-6dc7-4952-bc2d-0f4ee4efdb5e tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117838) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 14:43:11.642609 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6e1d81e8-6dc7-4952-bc2d-0f4ee4efdb5e tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:43:11.643143 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6e1d81e8-6dc7-4952-bc2d-0f4ee4efdb5e tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:43:11.643570 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6e1d81e8-6dc7-4952-bc2d-0f4ee4efdb5e tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:43:11.644370 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6e1d81e8-6dc7-4952-bc2d-0f4ee4efdb5e tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:43:11.645019 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6e1d81e8-6dc7-4952-bc2d-0f4ee4efdb5e tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:43:11.645613 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-6e1d81e8-6dc7-4952-bc2d-0f4ee4efdb5e tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:43:11.668181 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.quota [None req-6e1d81e8-6dc7-4952-bc2d-0f4ee4efdb5e tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Getting quotas for project 779be602b4054e6389c8ade7752e7ac2. Resources: {'cores', 'instances', 'ram'} {{(pid=117838) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 14:43:11.676782 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.quota [None req-6e1d81e8-6dc7-4952-bc2d-0f4ee4efdb5e tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Getting quotas for user 164c1e7ad0a74e68b4f4cc4bb3eef50e and project 779be602b4054e6389c8ade7752e7ac2. Resources: {'cores', 'instances', 'ram'} {{(pid=117838) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 14:43:11.751866 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-6e1d81e8-6dc7-4952-bc2d-0f4ee4efdb5e tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Going to run 1 instances... {{(pid=117838) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 14:43:11.754121 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-6e1d81e8-6dc7-4952-bc2d-0f4ee4efdb5e tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] [instance: 84dcb712-de3a-419f-9412-c0372430e976] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a0c49b54-6a9f-4ae4-ac4e-eeb08ac02178',volume_size=None,volume_type=None)] {{(pid=117838) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 14:43:11.943270 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-6e1d81e8-6dc7-4952-bc2d-0f4ee4efdb5e tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.733024 Aug 06 14:43:11.944141 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 531/1110] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Aug 6 14:43:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 1735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 14:43:11.952801 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_cell0:SELECT=4 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:43:11.953756 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:43:11.959176 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-cada3e03-82ab-468c-910b-4beb1bbd9238 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:43:11.959394 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-cada3e03-82ab-468c-910b-4beb1bbd9238 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] [instance: 84dcb712-de3a-419f-9412-c0372430e976] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:43:12.092510 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-cada3e03-82ab-468c-910b-4beb1bbd9238 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164c1e7ad0a74e68b4f4cc4bb3eef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779be602b4054e6389c8ade7752e7ac2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:43:12.105081 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-cada3e03-82ab-468c-910b-4beb1bbd9238 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] 10.222.0.17 "GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976" status: 200 len: 1088 microversion: 2.1 time: 0.153908 Aug 06 14:43:12.106147 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 580/1111] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:43:11 2022] GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976 => generated 1088 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:43:13.127099 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-864c3cde-4938-4649-997a-540f154037eb tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:43:13.127839 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-864c3cde-4938-4649-997a-540f154037eb tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] [instance: 84dcb712-de3a-419f-9412-c0372430e976] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:43:13.136680 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-864c3cde-4938-4649-997a-540f154037eb tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:43:13.137936 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-864c3cde-4938-4649-997a-540f154037eb tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:43:13.139392 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-864c3cde-4938-4649-997a-540f154037eb tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:43:13.140349 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-864c3cde-4938-4649-997a-540f154037eb tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:43:13.141029 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-864c3cde-4938-4649-997a-540f154037eb tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:43:13.141696 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-864c3cde-4938-4649-997a-540f154037eb tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:43:13.279911 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-864c3cde-4938-4649-997a-540f154037eb tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164c1e7ad0a74e68b4f4cc4bb3eef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779be602b4054e6389c8ade7752e7ac2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:43:13.288208 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-864c3cde-4938-4649-997a-540f154037eb tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] 10.222.0.17 "GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976" status: 200 len: 1186 microversion: 2.1 time: 0.166313 Aug 06 14:43:13.292346 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 532/1112] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:43:13 2022] GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976 => generated 1186 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:43:14.309821 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-638a184f-15ad-4ae6-abb9-0fcb70c9cd0b tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:43:14.310657 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-638a184f-15ad-4ae6-abb9-0fcb70c9cd0b tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] [instance: 84dcb712-de3a-419f-9412-c0372430e976] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:43:14.323574 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-638a184f-15ad-4ae6-abb9-0fcb70c9cd0b tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:43:14.327153 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-638a184f-15ad-4ae6-abb9-0fcb70c9cd0b tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:43:14.327851 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-638a184f-15ad-4ae6-abb9-0fcb70c9cd0b tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:43:14.328800 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-638a184f-15ad-4ae6-abb9-0fcb70c9cd0b tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:43:14.332541 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-638a184f-15ad-4ae6-abb9-0fcb70c9cd0b tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:43:14.335468 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-638a184f-15ad-4ae6-abb9-0fcb70c9cd0b tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:43:14.719513 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-638a184f-15ad-4ae6-abb9-0fcb70c9cd0b tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164c1e7ad0a74e68b4f4cc4bb3eef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779be602b4054e6389c8ade7752e7ac2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:43:14.739786 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-638a184f-15ad-4ae6-abb9-0fcb70c9cd0b tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] 10.222.0.17 "GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976" status: 200 len: 1204 microversion: 2.1 time: 0.434251 Aug 06 14:43:14.743427 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 581/1113] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:43:14 2022] GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976 => generated 1204 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:43:15.360161 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-3aafff38-f680-48df-98ee-5a38f1256b4d tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Action: 'create', calling method: .version_select at 0x7fbab178d040>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-603286594", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrtyCjEeHtZ3x/w7zBsQzXYaYsudqtus93nFkSk7KbeYEALygKn8K0SduwApSc0NEo/oa/EpxSvQTgWlN5OCNG1OisChDMn4u/JaXGzoCOkZtV/Ti+wkDD9Pf+vjjxVRw=="}} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:43:15.385500 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.quota [None req-3aafff38-f680-48df-98ee-5a38f1256b4d tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Getting quotas for project f344fdd32c8d482c8df161211d12fcd6. Resources: {'key_pairs'} {{(pid=117838) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 14:43:15.394187 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.quota [None req-3aafff38-f680-48df-98ee-5a38f1256b4d tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Getting quotas for user 0500bcc4b18e4e2cab39fb3d867cce70 and project f344fdd32c8d482c8df161211d12fcd6. Resources: {'key_pairs'} {{(pid=117838) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 14:43:15.417306 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-3aafff38-f680-48df-98ee-5a38f1256b4d tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.271318 Aug 06 14:43:15.417904 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 533/1114] 10.222.0.17 () {60 vars in 1159 bytes} [Sat Aug 6 14:43:15 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:43:15.762024 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-bf691469-3808-4a54-bbfc-ea34e20e2877 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:43:15.762686 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-bf691469-3808-4a54-bbfc-ea34e20e2877 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] [instance: 84dcb712-de3a-419f-9412-c0372430e976] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:43:15.770035 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-bf691469-3808-4a54-bbfc-ea34e20e2877 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:43:15.771002 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-bf691469-3808-4a54-bbfc-ea34e20e2877 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:43:15.771607 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-bf691469-3808-4a54-bbfc-ea34e20e2877 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:43:15.772506 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-bf691469-3808-4a54-bbfc-ea34e20e2877 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:43:15.773130 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-bf691469-3808-4a54-bbfc-ea34e20e2877 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:43:15.773742 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-bf691469-3808-4a54-bbfc-ea34e20e2877 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:43:15.816985 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [req-7ee1b8e8-66db-4116-8237-db2e3c736f6c req-14623cee-c74b-42c1-b39d-4f67e25fbbc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84dcb712-de3a-419f-9412-c0372430e976", "tag": "2bf6549d-c2c7-4ff1-8d53-d8423a286a3f"}]} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:43:15.839896 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-7ee1b8e8-66db-4116-8237-db2e3c736f6c req-14623cee-c74b-42c1-b39d-4f67e25fbbc2 service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:43:15.842733 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-7ee1b8e8-66db-4116-8237-db2e3c736f6c req-14623cee-c74b-42c1-b39d-4f67e25fbbc2 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:43:15.843918 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-7ee1b8e8-66db-4116-8237-db2e3c736f6c req-14623cee-c74b-42c1-b39d-4f67e25fbbc2 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:43:15.881089 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.compute.server_external_events [req-7ee1b8e8-66db-4116-8237-db2e3c736f6c req-14623cee-c74b-42c1-b39d-4f67e25fbbc2 service nova] Creating event network-changed:2bf6549d-c2c7-4ff1-8d53-d8423a286a3f for instance 84dcb712-de3a-419f-9412-c0372430e976 on hv-cinder-85199 Aug 06 14:43:15.889570 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [req-7ee1b8e8-66db-4116-8237-db2e3c736f6c req-14623cee-c74b-42c1-b39d-4f67e25fbbc2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080984 Aug 06 14:43:15.890886 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 534/1115] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:43:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 14:43:16.097900 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-bf691469-3808-4a54-bbfc-ea34e20e2877 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164c1e7ad0a74e68b4f4cc4bb3eef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779be602b4054e6389c8ade7752e7ac2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:43:16.109928 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-bf691469-3808-4a54-bbfc-ea34e20e2877 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] 10.222.0.17 "GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976" status: 200 len: 1260 microversion: 2.1 time: 0.351797 Aug 06 14:43:16.110999 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 582/1116] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:43:15 2022] GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976 => generated 1260 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:43:17.136681 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-8586457e-19fd-4178-bcd0-9dfa62487cd0 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:43:17.137383 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-8586457e-19fd-4178-bcd0-9dfa62487cd0 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] [instance: 84dcb712-de3a-419f-9412-c0372430e976] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:43:17.156758 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8586457e-19fd-4178-bcd0-9dfa62487cd0 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:43:17.157259 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8586457e-19fd-4178-bcd0-9dfa62487cd0 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:43:17.157727 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8586457e-19fd-4178-bcd0-9dfa62487cd0 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:43:17.159649 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8586457e-19fd-4178-bcd0-9dfa62487cd0 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:43:17.160192 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8586457e-19fd-4178-bcd0-9dfa62487cd0 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:43:17.160689 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-8586457e-19fd-4178-bcd0-9dfa62487cd0 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:43:17.314437 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-8586457e-19fd-4178-bcd0-9dfa62487cd0 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164c1e7ad0a74e68b4f4cc4bb3eef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779be602b4054e6389c8ade7752e7ac2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:43:17.322451 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-8586457e-19fd-4178-bcd0-9dfa62487cd0 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] 10.222.0.17 "GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976" status: 200 len: 1260 microversion: 2.1 time: 0.194855 Aug 06 14:43:17.323071 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 535/1117] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:43:17 2022] GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976 => generated 1260 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:43:18.343203 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-798f5937-913f-49ba-a4b3-6113ebe63562 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:43:18.343855 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-798f5937-913f-49ba-a4b3-6113ebe63562 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] [instance: 84dcb712-de3a-419f-9412-c0372430e976] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:43:18.350702 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-798f5937-913f-49ba-a4b3-6113ebe63562 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:43:18.351495 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-798f5937-913f-49ba-a4b3-6113ebe63562 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:43:18.352230 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-798f5937-913f-49ba-a4b3-6113ebe63562 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:43:18.353324 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-798f5937-913f-49ba-a4b3-6113ebe63562 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:43:18.353896 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-798f5937-913f-49ba-a4b3-6113ebe63562 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:43:18.354407 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-798f5937-913f-49ba-a4b3-6113ebe63562 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:43:18.500119 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-798f5937-913f-49ba-a4b3-6113ebe63562 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164c1e7ad0a74e68b4f4cc4bb3eef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779be602b4054e6389c8ade7752e7ac2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:43:18.514238 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-798f5937-913f-49ba-a4b3-6113ebe63562 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] 10.222.0.17 "GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976" status: 200 len: 1260 microversion: 2.1 time: 0.174922 Aug 06 14:43:18.514977 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 583/1118] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:43:18 2022] GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976 => generated 1260 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:43:19.536516 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-2c2ec301-6644-483f-ae32-429c0114b9ba tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:43:19.537254 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-2c2ec301-6644-483f-ae32-429c0114b9ba tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] [instance: 84dcb712-de3a-419f-9412-c0372430e976] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:43:19.544142 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2c2ec301-6644-483f-ae32-429c0114b9ba tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:43:19.544658 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2c2ec301-6644-483f-ae32-429c0114b9ba tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:43:19.545086 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2c2ec301-6644-483f-ae32-429c0114b9ba tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:43:19.545777 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2c2ec301-6644-483f-ae32-429c0114b9ba tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:43:19.546227 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2c2ec301-6644-483f-ae32-429c0114b9ba tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:43:19.546645 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-2c2ec301-6644-483f-ae32-429c0114b9ba tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:43:19.682585 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-2c2ec301-6644-483f-ae32-429c0114b9ba tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164c1e7ad0a74e68b4f4cc4bb3eef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779be602b4054e6389c8ade7752e7ac2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:43:19.690795 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-2c2ec301-6644-483f-ae32-429c0114b9ba tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] 10.222.0.17 "GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976" status: 200 len: 1260 microversion: 2.1 time: 0.159295 Aug 06 14:43:19.691383 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 536/1119] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:43:19 2022] GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:43:20.712074 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-845cb311-811b-4bed-8683-60549f0d37c8 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:43:20.712716 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-845cb311-811b-4bed-8683-60549f0d37c8 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] [instance: 84dcb712-de3a-419f-9412-c0372430e976] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:43:20.720344 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-845cb311-811b-4bed-8683-60549f0d37c8 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:43:20.720840 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-845cb311-811b-4bed-8683-60549f0d37c8 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:43:20.721285 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-845cb311-811b-4bed-8683-60549f0d37c8 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:43:20.721997 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-845cb311-811b-4bed-8683-60549f0d37c8 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:43:20.722464 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-845cb311-811b-4bed-8683-60549f0d37c8 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:43:20.722937 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-845cb311-811b-4bed-8683-60549f0d37c8 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:43:20.862598 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-845cb311-811b-4bed-8683-60549f0d37c8 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164c1e7ad0a74e68b4f4cc4bb3eef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779be602b4054e6389c8ade7752e7ac2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:43:20.870314 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-845cb311-811b-4bed-8683-60549f0d37c8 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] 10.222.0.17 "GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976" status: 200 len: 1260 microversion: 2.1 time: 0.162383 Aug 06 14:43:20.870896 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 584/1120] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:43:20 2022] GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976 => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:43:21.894465 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-373510fb-3995-4b0c-87ee-d4d05070e80a tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:43:21.895112 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-373510fb-3995-4b0c-87ee-d4d05070e80a tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] [instance: 84dcb712-de3a-419f-9412-c0372430e976] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:43:21.897547 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_cell0:SELECT=2 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:43:21.903106 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-373510fb-3995-4b0c-87ee-d4d05070e80a tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:43:21.903589 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-373510fb-3995-4b0c-87ee-d4d05070e80a tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:43:21.904023 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-373510fb-3995-4b0c-87ee-d4d05070e80a tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:43:21.904763 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-373510fb-3995-4b0c-87ee-d4d05070e80a tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:43:21.905216 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-373510fb-3995-4b0c-87ee-d4d05070e80a tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:43:21.905642 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-373510fb-3995-4b0c-87ee-d4d05070e80a tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:43:22.037590 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-373510fb-3995-4b0c-87ee-d4d05070e80a tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164c1e7ad0a74e68b4f4cc4bb3eef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779be602b4054e6389c8ade7752e7ac2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:43:22.045251 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-373510fb-3995-4b0c-87ee-d4d05070e80a tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] 10.222.0.17 "GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976" status: 200 len: 1260 microversion: 2.1 time: 0.154750 Aug 06 14:43:22.045816 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 537/1121] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:43:21 2022] GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:43:23.065866 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-34397bbe-fd70-4471-8402-d8b2e21e915c tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:43:23.066458 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-34397bbe-fd70-4471-8402-d8b2e21e915c tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] [instance: 84dcb712-de3a-419f-9412-c0372430e976] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:43:23.068820 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_cell0:SELECT=2 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:43:23.074077 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-34397bbe-fd70-4471-8402-d8b2e21e915c tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:43:23.074586 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-34397bbe-fd70-4471-8402-d8b2e21e915c tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:43:23.075052 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-34397bbe-fd70-4471-8402-d8b2e21e915c tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:43:23.075738 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-34397bbe-fd70-4471-8402-d8b2e21e915c tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:43:23.076194 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-34397bbe-fd70-4471-8402-d8b2e21e915c tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:43:23.077167 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-34397bbe-fd70-4471-8402-d8b2e21e915c tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:43:23.207269 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-34397bbe-fd70-4471-8402-d8b2e21e915c tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164c1e7ad0a74e68b4f4cc4bb3eef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779be602b4054e6389c8ade7752e7ac2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:43:23.214653 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-34397bbe-fd70-4471-8402-d8b2e21e915c tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] 10.222.0.17 "GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976" status: 200 len: 1260 microversion: 2.1 time: 0.152639 Aug 06 14:43:23.215255 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 585/1122] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:43:23 2022] GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:43:24.238264 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-73b8936c-b471-4b3e-b4d5-d21e41bb7fcd tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:43:24.238899 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-73b8936c-b471-4b3e-b4d5-d21e41bb7fcd tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] [instance: 84dcb712-de3a-419f-9412-c0372430e976] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:43:24.245622 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-73b8936c-b471-4b3e-b4d5-d21e41bb7fcd tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:43:24.246114 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-73b8936c-b471-4b3e-b4d5-d21e41bb7fcd tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:43:24.246551 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-73b8936c-b471-4b3e-b4d5-d21e41bb7fcd tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:43:24.247361 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-73b8936c-b471-4b3e-b4d5-d21e41bb7fcd tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:43:24.247818 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-73b8936c-b471-4b3e-b4d5-d21e41bb7fcd tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:43:24.248742 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-73b8936c-b471-4b3e-b4d5-d21e41bb7fcd tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:43:24.386705 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-73b8936c-b471-4b3e-b4d5-d21e41bb7fcd tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164c1e7ad0a74e68b4f4cc4bb3eef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779be602b4054e6389c8ade7752e7ac2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:43:24.394266 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-73b8936c-b471-4b3e-b4d5-d21e41bb7fcd tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] 10.222.0.17 "GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976" status: 200 len: 1260 microversion: 2.1 time: 0.161090 Aug 06 14:43:24.394762 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 538/1123] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:43:24 2022] GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:43:25.416504 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-b0d5c0da-4c19-4a7a-8f59-b12aa55ad9e6 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:43:25.417110 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-b0d5c0da-4c19-4a7a-8f59-b12aa55ad9e6 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] [instance: 84dcb712-de3a-419f-9412-c0372430e976] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:43:25.424025 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b0d5c0da-4c19-4a7a-8f59-b12aa55ad9e6 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:43:25.424501 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b0d5c0da-4c19-4a7a-8f59-b12aa55ad9e6 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:43:25.424932 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b0d5c0da-4c19-4a7a-8f59-b12aa55ad9e6 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:43:25.425612 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b0d5c0da-4c19-4a7a-8f59-b12aa55ad9e6 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:43:25.426066 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b0d5c0da-4c19-4a7a-8f59-b12aa55ad9e6 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:43:25.426484 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b0d5c0da-4c19-4a7a-8f59-b12aa55ad9e6 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:43:25.561761 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-b0d5c0da-4c19-4a7a-8f59-b12aa55ad9e6 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164c1e7ad0a74e68b4f4cc4bb3eef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779be602b4054e6389c8ade7752e7ac2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:43:25.569208 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-b0d5c0da-4c19-4a7a-8f59-b12aa55ad9e6 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] 10.222.0.17 "GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976" status: 200 len: 1260 microversion: 2.1 time: 0.156596 Aug 06 14:43:25.569771 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 586/1124] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:43:25 2022] GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:43:26.589569 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-00bf8f9a-02dc-4863-acdd-9885fe7ef4fa tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:43:26.590158 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-00bf8f9a-02dc-4863-acdd-9885fe7ef4fa tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] [instance: 84dcb712-de3a-419f-9412-c0372430e976] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:43:26.592493 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_cell0:SELECT=10 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:43:26.597783 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-00bf8f9a-02dc-4863-acdd-9885fe7ef4fa tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:43:26.598265 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-00bf8f9a-02dc-4863-acdd-9885fe7ef4fa tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:43:26.598697 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-00bf8f9a-02dc-4863-acdd-9885fe7ef4fa tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:43:26.599405 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-00bf8f9a-02dc-4863-acdd-9885fe7ef4fa tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:43:26.599861 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-00bf8f9a-02dc-4863-acdd-9885fe7ef4fa tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:43:26.600280 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-00bf8f9a-02dc-4863-acdd-9885fe7ef4fa tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:43:26.737521 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-00bf8f9a-02dc-4863-acdd-9885fe7ef4fa tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164c1e7ad0a74e68b4f4cc4bb3eef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779be602b4054e6389c8ade7752e7ac2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:43:26.745188 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-00bf8f9a-02dc-4863-acdd-9885fe7ef4fa tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] 10.222.0.17 "GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976" status: 200 len: 1260 microversion: 2.1 time: 0.159571 Aug 06 14:43:26.745778 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 539/1125] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:43:26 2022] GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:43:27.766608 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-a7d65263-f3b1-4886-a1a3-9ded85b352f0 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:43:27.767255 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-a7d65263-f3b1-4886-a1a3-9ded85b352f0 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] [instance: 84dcb712-de3a-419f-9412-c0372430e976] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:43:27.773511 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a7d65263-f3b1-4886-a1a3-9ded85b352f0 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:43:27.773994 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a7d65263-f3b1-4886-a1a3-9ded85b352f0 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:43:27.774454 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a7d65263-f3b1-4886-a1a3-9ded85b352f0 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:43:27.775154 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a7d65263-f3b1-4886-a1a3-9ded85b352f0 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:43:27.775606 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a7d65263-f3b1-4886-a1a3-9ded85b352f0 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:43:27.776032 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a7d65263-f3b1-4886-a1a3-9ded85b352f0 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:43:27.905163 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-a7d65263-f3b1-4886-a1a3-9ded85b352f0 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164c1e7ad0a74e68b4f4cc4bb3eef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779be602b4054e6389c8ade7752e7ac2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:43:27.912508 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-a7d65263-f3b1-4886-a1a3-9ded85b352f0 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] 10.222.0.17 "GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976" status: 200 len: 1260 microversion: 2.1 time: 0.150860 Aug 06 14:43:27.913068 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 587/1126] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:43:27 2022] GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:43:28.826425 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [req-63a86ffd-c517-4c76-be1d-cad9dcf62343 req-d99929a1-41ab-4852-a48a-0d24813cf37d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84dcb712-de3a-419f-9412-c0372430e976", "name": "network-vif-plugged", "status": "completed", "tag": "2bf6549d-c2c7-4ff1-8d53-d8423a286a3f"}]} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:43:28.836957 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-63a86ffd-c517-4c76-be1d-cad9dcf62343 req-d99929a1-41ab-4852-a48a-0d24813cf37d service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:43:28.837615 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-63a86ffd-c517-4c76-be1d-cad9dcf62343 req-d99929a1-41ab-4852-a48a-0d24813cf37d service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:43:28.838040 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-63a86ffd-c517-4c76-be1d-cad9dcf62343 req-d99929a1-41ab-4852-a48a-0d24813cf37d service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:43:28.850298 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.compute.server_external_events [req-63a86ffd-c517-4c76-be1d-cad9dcf62343 req-d99929a1-41ab-4852-a48a-0d24813cf37d service nova] Creating event network-vif-plugged:2bf6549d-c2c7-4ff1-8d53-d8423a286a3f for instance 84dcb712-de3a-419f-9412-c0372430e976 on hv-cinder-85199 Aug 06 14:43:28.855277 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [req-63a86ffd-c517-4c76-be1d-cad9dcf62343 req-d99929a1-41ab-4852-a48a-0d24813cf37d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032538 Aug 06 14:43:28.855870 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 540/1127] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:43:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 14:43:28.932667 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-0193270c-1ea7-4b41-8834-dfae343c7fc1 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:43:28.933274 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-0193270c-1ea7-4b41-8834-dfae343c7fc1 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] [instance: 84dcb712-de3a-419f-9412-c0372430e976] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:43:28.939841 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0193270c-1ea7-4b41-8834-dfae343c7fc1 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:43:28.940323 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0193270c-1ea7-4b41-8834-dfae343c7fc1 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:43:28.940755 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0193270c-1ea7-4b41-8834-dfae343c7fc1 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:43:28.941434 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0193270c-1ea7-4b41-8834-dfae343c7fc1 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:43:28.941884 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0193270c-1ea7-4b41-8834-dfae343c7fc1 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:43:28.942304 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0193270c-1ea7-4b41-8834-dfae343c7fc1 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:43:29.092673 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-0193270c-1ea7-4b41-8834-dfae343c7fc1 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164c1e7ad0a74e68b4f4cc4bb3eef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779be602b4054e6389c8ade7752e7ac2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:43:29.101015 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-0193270c-1ea7-4b41-8834-dfae343c7fc1 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] 10.222.0.17 "GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976" status: 200 len: 1260 microversion: 2.1 time: 0.172196 Aug 06 14:43:29.101584 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 588/1128] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:43:28 2022] GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976 => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:43:30.122595 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-d152ba48-8be0-4d03-a9bd-451858366808 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:43:30.123260 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-d152ba48-8be0-4d03-a9bd-451858366808 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] [instance: 84dcb712-de3a-419f-9412-c0372430e976] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:43:30.129378 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d152ba48-8be0-4d03-a9bd-451858366808 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:43:30.129852 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d152ba48-8be0-4d03-a9bd-451858366808 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:43:30.130280 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d152ba48-8be0-4d03-a9bd-451858366808 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:43:30.130978 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d152ba48-8be0-4d03-a9bd-451858366808 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:43:30.131429 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d152ba48-8be0-4d03-a9bd-451858366808 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:43:30.131848 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d152ba48-8be0-4d03-a9bd-451858366808 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:43:30.267204 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-d152ba48-8be0-4d03-a9bd-451858366808 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164c1e7ad0a74e68b4f4cc4bb3eef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779be602b4054e6389c8ade7752e7ac2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:43:30.274957 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-d152ba48-8be0-4d03-a9bd-451858366808 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] 10.222.0.17 "GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976" status: 200 len: 1260 microversion: 2.1 time: 0.157076 Aug 06 14:43:30.275514 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 541/1129] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:43:30 2022] GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:43:31.296091 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-a9c6dfd3-478c-4004-aaed-73fc908d5c1e tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:43:31.296703 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-a9c6dfd3-478c-4004-aaed-73fc908d5c1e tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] [instance: 84dcb712-de3a-419f-9412-c0372430e976] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:43:31.302697 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a9c6dfd3-478c-4004-aaed-73fc908d5c1e tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:43:31.303208 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a9c6dfd3-478c-4004-aaed-73fc908d5c1e tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:43:31.303640 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a9c6dfd3-478c-4004-aaed-73fc908d5c1e tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:43:31.304465 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a9c6dfd3-478c-4004-aaed-73fc908d5c1e tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:43:31.304927 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a9c6dfd3-478c-4004-aaed-73fc908d5c1e tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:43:31.305348 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a9c6dfd3-478c-4004-aaed-73fc908d5c1e tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:43:31.433900 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-a9c6dfd3-478c-4004-aaed-73fc908d5c1e tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164c1e7ad0a74e68b4f4cc4bb3eef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779be602b4054e6389c8ade7752e7ac2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:43:31.442377 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-a9c6dfd3-478c-4004-aaed-73fc908d5c1e tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] 10.222.0.17 "GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976" status: 200 len: 1444 microversion: 2.1 time: 0.150688 Aug 06 14:43:31.442964 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 589/1130] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:43:31 2022] GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976 => generated 1444 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:43:31.461607 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-05dd610d-9dfc-4cc1-8341-219fcb05f118 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:43:31.462214 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-05dd610d-9dfc-4cc1-8341-219fcb05f118 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] [instance: 84dcb712-de3a-419f-9412-c0372430e976] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:43:31.468468 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-05dd610d-9dfc-4cc1-8341-219fcb05f118 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:43:31.468943 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-05dd610d-9dfc-4cc1-8341-219fcb05f118 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:43:31.469371 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-05dd610d-9dfc-4cc1-8341-219fcb05f118 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:43:31.470045 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-05dd610d-9dfc-4cc1-8341-219fcb05f118 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:43:31.470491 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-05dd610d-9dfc-4cc1-8341-219fcb05f118 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:43:31.470932 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-05dd610d-9dfc-4cc1-8341-219fcb05f118 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:43:31.605960 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-05dd610d-9dfc-4cc1-8341-219fcb05f118 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164c1e7ad0a74e68b4f4cc4bb3eef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779be602b4054e6389c8ade7752e7ac2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:43:31.614527 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-05dd610d-9dfc-4cc1-8341-219fcb05f118 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] 10.222.0.17 "GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976" status: 200 len: 1444 microversion: 2.1 time: 0.156657 Aug 06 14:43:31.615123 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 542/1131] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:43:31 2022] GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976 => generated 1444 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:43:33.349437 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [req-a88872bb-3575-4fe2-b6b2-2166e4236c50 req-07da7be2-1d0f-4be2-9403-96637442c75c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84dcb712-de3a-419f-9412-c0372430e976", "tag": "2bf6549d-c2c7-4ff1-8d53-d8423a286a3f"}]} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:43:33.359403 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-a88872bb-3575-4fe2-b6b2-2166e4236c50 req-07da7be2-1d0f-4be2-9403-96637442c75c service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:43:33.359877 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-a88872bb-3575-4fe2-b6b2-2166e4236c50 req-07da7be2-1d0f-4be2-9403-96637442c75c service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:43:33.360307 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-a88872bb-3575-4fe2-b6b2-2166e4236c50 req-07da7be2-1d0f-4be2-9403-96637442c75c service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:43:33.371456 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.compute.server_external_events [req-a88872bb-3575-4fe2-b6b2-2166e4236c50 req-07da7be2-1d0f-4be2-9403-96637442c75c service nova] Creating event network-changed:2bf6549d-c2c7-4ff1-8d53-d8423a286a3f for instance 84dcb712-de3a-419f-9412-c0372430e976 on hv-cinder-85199 Aug 06 14:43:33.376466 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [req-a88872bb-3575-4fe2-b6b2-2166e4236c50 req-07da7be2-1d0f-4be2-9403-96637442c75c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089358 Aug 06 14:43:33.377250 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 590/1132] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:43:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 14:43:40.231030 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-c0c4c9b0-7c50-4736-889c-b55ba01c1793 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1061809043", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-603286594", "security_groups": [{"name": "tempest-secgroup-smoke-1234795654"}], "block_device_mapping_v2": [{"uuid": "b45a6eb0-80fb-43f3-9b6f-a8fc8d0dfb00", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "75577732-bec1-435e-9165-942aae4827a6"}]}} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:43:40.241035 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=4 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:43:40.345659 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.network.neutron [None req-c0c4c9b0-7c50-4736-889c-b55ba01c1793 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] validate_networks() for [('75577732-bec1-435e-9165-942aae4827a6', None, None, None, None, None)] {{(pid=117838) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 14:43:40.951925 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.virt.hardware [None req-c0c4c9b0-7c50-4736-889c-b55ba01c1793 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Flavor limits 0:0:0 {{(pid=117838) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 14:43:40.952345 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.virt.hardware [None req-c0c4c9b0-7c50-4736-889c-b55ba01c1793 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Image limits 0:0:0 {{(pid=117838) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 14:43:40.952812 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.virt.hardware [None req-c0c4c9b0-7c50-4736-889c-b55ba01c1793 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Flavor pref 0:0:0 {{(pid=117838) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 14:43:40.953217 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.virt.hardware [None req-c0c4c9b0-7c50-4736-889c-b55ba01c1793 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Image pref 0:0:0 {{(pid=117838) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 14:43:40.953622 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.virt.hardware [None req-c0c4c9b0-7c50-4736-889c-b55ba01c1793 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117838) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 14:43:40.962157 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c0c4c9b0-7c50-4736-889c-b55ba01c1793 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:43:40.962630 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c0c4c9b0-7c50-4736-889c-b55ba01c1793 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:43:40.963107 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c0c4c9b0-7c50-4736-889c-b55ba01c1793 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:43:40.963808 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c0c4c9b0-7c50-4736-889c-b55ba01c1793 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:43:40.964254 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c0c4c9b0-7c50-4736-889c-b55ba01c1793 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:43:40.964677 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c0c4c9b0-7c50-4736-889c-b55ba01c1793 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:43:40.971251 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_cell1:SELECT=55 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:43:40.982124 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.quota [None req-c0c4c9b0-7c50-4736-889c-b55ba01c1793 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Getting quotas for project f344fdd32c8d482c8df161211d12fcd6. Resources: {'cores', 'instances', 'ram'} {{(pid=117838) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 14:43:40.986462 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.quota [None req-c0c4c9b0-7c50-4736-889c-b55ba01c1793 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Getting quotas for user 0500bcc4b18e4e2cab39fb3d867cce70 and project f344fdd32c8d482c8df161211d12fcd6. Resources: {'cores', 'instances', 'ram'} {{(pid=117838) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 14:43:41.041325 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-c0c4c9b0-7c50-4736-889c-b55ba01c1793 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Going to run 1 instances... {{(pid=117838) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 14:43:41.043434 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-c0c4c9b0-7c50-4736-889c-b55ba01c1793 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] [instance: 20d7f033-8d80-4f4c-89d4-76d92081a555] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b45a6eb0-80fb-43f3-9b6f-a8fc8d0dfb00',volume_size=None,volume_type=None)] {{(pid=117838) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 14:43:41.167634 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-c0c4c9b0-7c50-4736-889c-b55ba01c1793 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.940444 Aug 06 14:43:41.168268 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 543/1133] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Aug 6 14:43:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 942 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 14:43:41.180562 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-1bf1ebb5-bf4a-4eb6-83e3-d0ae88b3418d tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:43:41.181258 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-1bf1ebb5-bf4a-4eb6-83e3-d0ae88b3418d tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] [instance: 20d7f033-8d80-4f4c-89d4-76d92081a555] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:43:41.234397 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-1bf1ebb5-bf4a-4eb6-83e3-d0ae88b3418d tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0500bcc4b18e4e2cab39fb3d867cce70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f344fdd32c8d482c8df161211d12fcd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:43:41.241039 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-1bf1ebb5-bf4a-4eb6-83e3-d0ae88b3418d tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] 10.222.0.17 "GET /compute/v2.1/servers/20d7f033-8d80-4f4c-89d4-76d92081a555" status: 200 len: 1094 microversion: 2.1 time: 0.065359 Aug 06 14:43:41.241601 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 591/1134] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:43:41 2022] GET /compute/v2.1/servers/20d7f033-8d80-4f4c-89d4-76d92081a555 => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:43:42.263266 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-d3f6a4d7-1416-446c-9fb3-f173aec034a3 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:43:42.265261 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-d3f6a4d7-1416-446c-9fb3-f173aec034a3 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] [instance: 20d7f033-8d80-4f4c-89d4-76d92081a555] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:43:42.272484 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d3f6a4d7-1416-446c-9fb3-f173aec034a3 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:43:42.272966 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d3f6a4d7-1416-446c-9fb3-f173aec034a3 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:43:42.273398 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d3f6a4d7-1416-446c-9fb3-f173aec034a3 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:43:42.274097 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d3f6a4d7-1416-446c-9fb3-f173aec034a3 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:43:42.274543 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d3f6a4d7-1416-446c-9fb3-f173aec034a3 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:43:42.275007 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d3f6a4d7-1416-446c-9fb3-f173aec034a3 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:43:42.343225 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-d3f6a4d7-1416-446c-9fb3-f173aec034a3 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0500bcc4b18e4e2cab39fb3d867cce70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f344fdd32c8d482c8df161211d12fcd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:43:42.351072 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-d3f6a4d7-1416-446c-9fb3-f173aec034a3 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] 10.222.0.17 "GET /compute/v2.1/servers/20d7f033-8d80-4f4c-89d4-76d92081a555" status: 200 len: 1200 microversion: 2.1 time: 0.093309 Aug 06 14:43:42.351654 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 544/1135] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:43:42 2022] GET /compute/v2.1/servers/20d7f033-8d80-4f4c-89d4-76d92081a555 => generated 1200 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:43:43.371302 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-514461a1-e0b9-40be-9632-5c4ec2e0a417 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:43:43.372016 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-514461a1-e0b9-40be-9632-5c4ec2e0a417 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] [instance: 20d7f033-8d80-4f4c-89d4-76d92081a555] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:43:43.374625 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_cell1:SELECT=56 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:43:43.375384 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_api:SELECT=29 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:43:43.382020 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-514461a1-e0b9-40be-9632-5c4ec2e0a417 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:43:43.382581 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-514461a1-e0b9-40be-9632-5c4ec2e0a417 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:43:43.383192 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-514461a1-e0b9-40be-9632-5c4ec2e0a417 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:43:43.383950 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-514461a1-e0b9-40be-9632-5c4ec2e0a417 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:43:43.384471 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-514461a1-e0b9-40be-9632-5c4ec2e0a417 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:43:43.384961 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-514461a1-e0b9-40be-9632-5c4ec2e0a417 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:43:43.609837 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-514461a1-e0b9-40be-9632-5c4ec2e0a417 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0500bcc4b18e4e2cab39fb3d867cce70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f344fdd32c8d482c8df161211d12fcd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:43:43.617474 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-514461a1-e0b9-40be-9632-5c4ec2e0a417 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] 10.222.0.17 "GET /compute/v2.1/servers/20d7f033-8d80-4f4c-89d4-76d92081a555" status: 200 len: 1266 microversion: 2.1 time: 0.250038 Aug 06 14:43:43.618360 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 592/1136] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:43:43 2022] GET /compute/v2.1/servers/20d7f033-8d80-4f4c-89d4-76d92081a555 => generated 1266 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:43:43.693658 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [req-1c4b34cc-047f-436d-b664-bbcab55d515b req-3e1ce0d5-502b-4dd2-aaff-efc7a80790ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20d7f033-8d80-4f4c-89d4-76d92081a555", "tag": "36ba90c5-56a8-41a5-94e3-70efe8df3203"}]} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:43:43.705106 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-1c4b34cc-047f-436d-b664-bbcab55d515b req-3e1ce0d5-502b-4dd2-aaff-efc7a80790ed service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:43:43.705903 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-1c4b34cc-047f-436d-b664-bbcab55d515b req-3e1ce0d5-502b-4dd2-aaff-efc7a80790ed service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:43:43.706203 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-1c4b34cc-047f-436d-b664-bbcab55d515b req-3e1ce0d5-502b-4dd2-aaff-efc7a80790ed service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:43:43.717517 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.compute.server_external_events [req-1c4b34cc-047f-436d-b664-bbcab55d515b req-3e1ce0d5-502b-4dd2-aaff-efc7a80790ed service nova] Creating event network-changed:36ba90c5-56a8-41a5-94e3-70efe8df3203 for instance 20d7f033-8d80-4f4c-89d4-76d92081a555 on hv-cinder-85199 Aug 06 14:43:43.722445 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [req-1c4b34cc-047f-436d-b664-bbcab55d515b req-3e1ce0d5-502b-4dd2-aaff-efc7a80790ed service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032507 Aug 06 14:43:43.723264 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 545/1137] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 14:43:44.639394 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-bb333877-5697-4dbc-bd74-e46c4aab67a9 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:43:44.640006 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-bb333877-5697-4dbc-bd74-e46c4aab67a9 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] [instance: 20d7f033-8d80-4f4c-89d4-76d92081a555] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:43:44.646433 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-bb333877-5697-4dbc-bd74-e46c4aab67a9 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:43:44.646936 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-bb333877-5697-4dbc-bd74-e46c4aab67a9 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:43:44.647375 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-bb333877-5697-4dbc-bd74-e46c4aab67a9 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:43:44.648063 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-bb333877-5697-4dbc-bd74-e46c4aab67a9 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:43:44.648518 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-bb333877-5697-4dbc-bd74-e46c4aab67a9 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:43:44.648943 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-bb333877-5697-4dbc-bd74-e46c4aab67a9 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:43:44.776298 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-bb333877-5697-4dbc-bd74-e46c4aab67a9 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0500bcc4b18e4e2cab39fb3d867cce70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f344fdd32c8d482c8df161211d12fcd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:43:44.784427 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-bb333877-5697-4dbc-bd74-e46c4aab67a9 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] 10.222.0.17 "GET /compute/v2.1/servers/20d7f033-8d80-4f4c-89d4-76d92081a555" status: 200 len: 1266 microversion: 2.1 time: 0.149297 Aug 06 14:43:44.784992 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 593/1138] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:43:44 2022] GET /compute/v2.1/servers/20d7f033-8d80-4f4c-89d4-76d92081a555 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:43:45.806762 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-4bc5912c-429d-4bf6-aeca-9161c104fd97 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:43:45.807395 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-4bc5912c-429d-4bf6-aeca-9161c104fd97 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] [instance: 20d7f033-8d80-4f4c-89d4-76d92081a555] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:43:45.814288 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4bc5912c-429d-4bf6-aeca-9161c104fd97 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:43:45.814765 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4bc5912c-429d-4bf6-aeca-9161c104fd97 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:43:45.815238 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4bc5912c-429d-4bf6-aeca-9161c104fd97 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:43:45.815915 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4bc5912c-429d-4bf6-aeca-9161c104fd97 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:43:45.816377 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4bc5912c-429d-4bf6-aeca-9161c104fd97 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:43:45.816779 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-4bc5912c-429d-4bf6-aeca-9161c104fd97 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:43:45.951555 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-4bc5912c-429d-4bf6-aeca-9161c104fd97 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0500bcc4b18e4e2cab39fb3d867cce70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f344fdd32c8d482c8df161211d12fcd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:43:45.958969 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-4bc5912c-429d-4bf6-aeca-9161c104fd97 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] 10.222.0.17 "GET /compute/v2.1/servers/20d7f033-8d80-4f4c-89d4-76d92081a555" status: 200 len: 1266 microversion: 2.1 time: 0.157001 Aug 06 14:43:45.959526 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 546/1139] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:43:45 2022] GET /compute/v2.1/servers/20d7f033-8d80-4f4c-89d4-76d92081a555 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:43:46.978849 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-67f20e19-96bd-48a9-a371-a6cde43e9f6d tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:43:46.979491 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-67f20e19-96bd-48a9-a371-a6cde43e9f6d tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] [instance: 20d7f033-8d80-4f4c-89d4-76d92081a555] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:43:46.985865 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-67f20e19-96bd-48a9-a371-a6cde43e9f6d tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:43:46.986342 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-67f20e19-96bd-48a9-a371-a6cde43e9f6d tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:43:46.986778 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-67f20e19-96bd-48a9-a371-a6cde43e9f6d tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:43:46.987517 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-67f20e19-96bd-48a9-a371-a6cde43e9f6d tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:43:46.987968 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-67f20e19-96bd-48a9-a371-a6cde43e9f6d tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:43:46.988393 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-67f20e19-96bd-48a9-a371-a6cde43e9f6d tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:43:47.117421 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-67f20e19-96bd-48a9-a371-a6cde43e9f6d tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0500bcc4b18e4e2cab39fb3d867cce70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f344fdd32c8d482c8df161211d12fcd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:43:47.124773 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-67f20e19-96bd-48a9-a371-a6cde43e9f6d tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] 10.222.0.17 "GET /compute/v2.1/servers/20d7f033-8d80-4f4c-89d4-76d92081a555" status: 200 len: 1266 microversion: 2.1 time: 0.149804 Aug 06 14:43:47.125343 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 594/1140] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:43:46 2022] GET /compute/v2.1/servers/20d7f033-8d80-4f4c-89d4-76d92081a555 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:43:48.145115 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-a288b059-d96c-421d-a8e3-c94221dacb6e tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:43:48.145726 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-a288b059-d96c-421d-a8e3-c94221dacb6e tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] [instance: 20d7f033-8d80-4f4c-89d4-76d92081a555] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:43:48.152113 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a288b059-d96c-421d-a8e3-c94221dacb6e tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:43:48.152589 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a288b059-d96c-421d-a8e3-c94221dacb6e tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:43:48.153018 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a288b059-d96c-421d-a8e3-c94221dacb6e tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:43:48.153697 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a288b059-d96c-421d-a8e3-c94221dacb6e tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:43:48.154633 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a288b059-d96c-421d-a8e3-c94221dacb6e tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:43:48.155084 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a288b059-d96c-421d-a8e3-c94221dacb6e tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:43:48.282803 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-a288b059-d96c-421d-a8e3-c94221dacb6e tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0500bcc4b18e4e2cab39fb3d867cce70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f344fdd32c8d482c8df161211d12fcd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:43:48.290140 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-a288b059-d96c-421d-a8e3-c94221dacb6e tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] 10.222.0.17 "GET /compute/v2.1/servers/20d7f033-8d80-4f4c-89d4-76d92081a555" status: 200 len: 1266 microversion: 2.1 time: 0.148898 Aug 06 14:43:48.290696 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 547/1141] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:43:48 2022] GET /compute/v2.1/servers/20d7f033-8d80-4f4c-89d4-76d92081a555 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:43:49.311133 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-0fbb28fa-231b-46b0-bc4f-f4576e90248c tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:43:49.311724 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-0fbb28fa-231b-46b0-bc4f-f4576e90248c tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] [instance: 20d7f033-8d80-4f4c-89d4-76d92081a555] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:43:49.318080 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0fbb28fa-231b-46b0-bc4f-f4576e90248c tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:43:49.318559 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0fbb28fa-231b-46b0-bc4f-f4576e90248c tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:43:49.319020 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0fbb28fa-231b-46b0-bc4f-f4576e90248c tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:43:49.319704 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0fbb28fa-231b-46b0-bc4f-f4576e90248c tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:43:49.320161 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0fbb28fa-231b-46b0-bc4f-f4576e90248c tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:43:49.320583 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0fbb28fa-231b-46b0-bc4f-f4576e90248c tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:43:49.448745 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-0fbb28fa-231b-46b0-bc4f-f4576e90248c tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0500bcc4b18e4e2cab39fb3d867cce70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f344fdd32c8d482c8df161211d12fcd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:43:49.456642 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-0fbb28fa-231b-46b0-bc4f-f4576e90248c tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] 10.222.0.17 "GET /compute/v2.1/servers/20d7f033-8d80-4f4c-89d4-76d92081a555" status: 200 len: 1266 microversion: 2.1 time: 0.149648 Aug 06 14:43:49.457203 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 595/1142] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:43:49 2022] GET /compute/v2.1/servers/20d7f033-8d80-4f4c-89d4-76d92081a555 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:43:50.480367 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-64686f81-b84f-4a06-8520-be762267331a tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:43:50.480904 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-64686f81-b84f-4a06-8520-be762267331a tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] [instance: 20d7f033-8d80-4f4c-89d4-76d92081a555] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:43:50.487844 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-64686f81-b84f-4a06-8520-be762267331a tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:43:50.488319 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-64686f81-b84f-4a06-8520-be762267331a tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:43:50.488744 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-64686f81-b84f-4a06-8520-be762267331a tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:43:50.489425 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-64686f81-b84f-4a06-8520-be762267331a tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:43:50.489872 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-64686f81-b84f-4a06-8520-be762267331a tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:43:50.490292 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-64686f81-b84f-4a06-8520-be762267331a tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:43:50.622892 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-64686f81-b84f-4a06-8520-be762267331a tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0500bcc4b18e4e2cab39fb3d867cce70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f344fdd32c8d482c8df161211d12fcd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:43:50.630160 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-64686f81-b84f-4a06-8520-be762267331a tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] 10.222.0.17 "GET /compute/v2.1/servers/20d7f033-8d80-4f4c-89d4-76d92081a555" status: 200 len: 1266 microversion: 2.1 time: 0.153730 Aug 06 14:43:50.630728 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 548/1143] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:43:50 2022] GET /compute/v2.1/servers/20d7f033-8d80-4f4c-89d4-76d92081a555 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:43:51.649666 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-a5b2ef66-bf64-41bb-8afe-22cca589acee tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:43:51.650265 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-a5b2ef66-bf64-41bb-8afe-22cca589acee tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] [instance: 20d7f033-8d80-4f4c-89d4-76d92081a555] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:43:51.652593 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_cell0:SELECT=2 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:43:51.658033 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a5b2ef66-bf64-41bb-8afe-22cca589acee tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:43:51.658509 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a5b2ef66-bf64-41bb-8afe-22cca589acee tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:43:51.659014 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a5b2ef66-bf64-41bb-8afe-22cca589acee tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:43:51.659703 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a5b2ef66-bf64-41bb-8afe-22cca589acee tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:43:51.660154 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a5b2ef66-bf64-41bb-8afe-22cca589acee tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:43:51.660577 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a5b2ef66-bf64-41bb-8afe-22cca589acee tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:43:51.788794 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-a5b2ef66-bf64-41bb-8afe-22cca589acee tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0500bcc4b18e4e2cab39fb3d867cce70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f344fdd32c8d482c8df161211d12fcd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:43:51.796400 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-a5b2ef66-bf64-41bb-8afe-22cca589acee tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] 10.222.0.17 "GET /compute/v2.1/servers/20d7f033-8d80-4f4c-89d4-76d92081a555" status: 200 len: 1266 microversion: 2.1 time: 0.150689 Aug 06 14:43:51.796959 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 596/1144] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:43:51 2022] GET /compute/v2.1/servers/20d7f033-8d80-4f4c-89d4-76d92081a555 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:43:52.818108 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-64bc1e13-fa56-41d2-9b35-348584d70f73 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:43:52.818711 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-64bc1e13-fa56-41d2-9b35-348584d70f73 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] [instance: 20d7f033-8d80-4f4c-89d4-76d92081a555] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:43:52.820665 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_cell0:SELECT=2 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:43:52.821467 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_cell0:SELECT=6 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:43:52.827665 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-64bc1e13-fa56-41d2-9b35-348584d70f73 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:43:52.828150 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-64bc1e13-fa56-41d2-9b35-348584d70f73 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:43:52.829225 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-64bc1e13-fa56-41d2-9b35-348584d70f73 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:43:52.829918 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-64bc1e13-fa56-41d2-9b35-348584d70f73 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:43:52.830536 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-64bc1e13-fa56-41d2-9b35-348584d70f73 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:43:52.830993 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-64bc1e13-fa56-41d2-9b35-348584d70f73 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:43:52.970465 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-64bc1e13-fa56-41d2-9b35-348584d70f73 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0500bcc4b18e4e2cab39fb3d867cce70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f344fdd32c8d482c8df161211d12fcd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:43:52.977927 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-64bc1e13-fa56-41d2-9b35-348584d70f73 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] 10.222.0.17 "GET /compute/v2.1/servers/20d7f033-8d80-4f4c-89d4-76d92081a555" status: 200 len: 1266 microversion: 2.1 time: 0.163646 Aug 06 14:43:52.978490 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 549/1145] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:43:52 2022] GET /compute/v2.1/servers/20d7f033-8d80-4f4c-89d4-76d92081a555 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:43:53.999221 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-3020e76b-5d4a-4adc-a1f6-77574b4fab22 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:43:53.999829 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-3020e76b-5d4a-4adc-a1f6-77574b4fab22 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] [instance: 20d7f033-8d80-4f4c-89d4-76d92081a555] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:43:54.006923 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-3020e76b-5d4a-4adc-a1f6-77574b4fab22 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:43:54.007402 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-3020e76b-5d4a-4adc-a1f6-77574b4fab22 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:43:54.007833 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-3020e76b-5d4a-4adc-a1f6-77574b4fab22 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:43:54.008510 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-3020e76b-5d4a-4adc-a1f6-77574b4fab22 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:43:54.008960 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-3020e76b-5d4a-4adc-a1f6-77574b4fab22 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:43:54.009380 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-3020e76b-5d4a-4adc-a1f6-77574b4fab22 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:43:54.139962 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-3020e76b-5d4a-4adc-a1f6-77574b4fab22 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0500bcc4b18e4e2cab39fb3d867cce70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f344fdd32c8d482c8df161211d12fcd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:43:54.148022 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-3020e76b-5d4a-4adc-a1f6-77574b4fab22 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] 10.222.0.17 "GET /compute/v2.1/servers/20d7f033-8d80-4f4c-89d4-76d92081a555" status: 200 len: 1266 microversion: 2.1 time: 0.152774 Aug 06 14:43:54.148589 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 597/1146] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:43:53 2022] GET /compute/v2.1/servers/20d7f033-8d80-4f4c-89d4-76d92081a555 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:43:54.967729 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [req-1237f0bd-8142-4001-a0c9-a0ea41cbe27b req-069df855-c617-4164-9c11-3997634933ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20d7f033-8d80-4f4c-89d4-76d92081a555", "name": "network-vif-plugged", "status": "completed", "tag": "36ba90c5-56a8-41a5-94e3-70efe8df3203"}]} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:43:54.978534 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-1237f0bd-8142-4001-a0c9-a0ea41cbe27b req-069df855-c617-4164-9c11-3997634933ec service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:43:54.979039 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-1237f0bd-8142-4001-a0c9-a0ea41cbe27b req-069df855-c617-4164-9c11-3997634933ec service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:43:54.979464 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-1237f0bd-8142-4001-a0c9-a0ea41cbe27b req-069df855-c617-4164-9c11-3997634933ec service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:43:54.992055 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.compute.server_external_events [req-1237f0bd-8142-4001-a0c9-a0ea41cbe27b req-069df855-c617-4164-9c11-3997634933ec service nova] Creating event network-vif-plugged:36ba90c5-56a8-41a5-94e3-70efe8df3203 for instance 20d7f033-8d80-4f4c-89d4-76d92081a555 on hv-cinder-85199 Aug 06 14:43:54.996971 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [req-1237f0bd-8142-4001-a0c9-a0ea41cbe27b req-069df855-c617-4164-9c11-3997634933ec service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033325 Aug 06 14:43:54.997556 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 550/1147] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:43:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:43:55.168743 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-06de5023-353a-40b0-840a-cf79588f7770 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:43:55.169389 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-06de5023-353a-40b0-840a-cf79588f7770 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] [instance: 20d7f033-8d80-4f4c-89d4-76d92081a555] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:43:55.177127 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-06de5023-353a-40b0-840a-cf79588f7770 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:43:55.177608 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-06de5023-353a-40b0-840a-cf79588f7770 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:43:55.178040 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-06de5023-353a-40b0-840a-cf79588f7770 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:43:55.178734 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-06de5023-353a-40b0-840a-cf79588f7770 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:43:55.179248 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-06de5023-353a-40b0-840a-cf79588f7770 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:43:55.179672 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-06de5023-353a-40b0-840a-cf79588f7770 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:43:55.367981 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-06de5023-353a-40b0-840a-cf79588f7770 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0500bcc4b18e4e2cab39fb3d867cce70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f344fdd32c8d482c8df161211d12fcd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:43:55.375477 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-06de5023-353a-40b0-840a-cf79588f7770 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] 10.222.0.17 "GET /compute/v2.1/servers/20d7f033-8d80-4f4c-89d4-76d92081a555" status: 200 len: 1266 microversion: 2.1 time: 0.210770 Aug 06 14:43:55.376042 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 598/1148] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:43:55 2022] GET /compute/v2.1/servers/20d7f033-8d80-4f4c-89d4-76d92081a555 => generated 1266 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:43:56.396237 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-ec1bc01f-fc7b-4cf1-9140-ccbc456f1782 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:43:56.396928 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-ec1bc01f-fc7b-4cf1-9140-ccbc456f1782 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] [instance: 20d7f033-8d80-4f4c-89d4-76d92081a555] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:43:56.403022 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ec1bc01f-fc7b-4cf1-9140-ccbc456f1782 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:43:56.403496 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ec1bc01f-fc7b-4cf1-9140-ccbc456f1782 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:43:56.403924 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ec1bc01f-fc7b-4cf1-9140-ccbc456f1782 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:43:56.404598 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ec1bc01f-fc7b-4cf1-9140-ccbc456f1782 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:43:56.405045 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ec1bc01f-fc7b-4cf1-9140-ccbc456f1782 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:43:56.405461 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ec1bc01f-fc7b-4cf1-9140-ccbc456f1782 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:43:56.535054 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-ec1bc01f-fc7b-4cf1-9140-ccbc456f1782 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0500bcc4b18e4e2cab39fb3d867cce70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f344fdd32c8d482c8df161211d12fcd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:43:56.542363 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-ec1bc01f-fc7b-4cf1-9140-ccbc456f1782 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] 10.222.0.17 "GET /compute/v2.1/servers/20d7f033-8d80-4f4c-89d4-76d92081a555" status: 200 len: 1266 microversion: 2.1 time: 0.150802 Aug 06 14:43:56.542931 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 551/1149] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:43:56 2022] GET /compute/v2.1/servers/20d7f033-8d80-4f4c-89d4-76d92081a555 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:43:57.563982 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-e77af2f8-4c87-42ff-9ab3-0ab3a4f880a9 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:43:57.564590 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-e77af2f8-4c87-42ff-9ab3-0ab3a4f880a9 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] [instance: 20d7f033-8d80-4f4c-89d4-76d92081a555] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:43:57.570850 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e77af2f8-4c87-42ff-9ab3-0ab3a4f880a9 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:43:57.571346 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e77af2f8-4c87-42ff-9ab3-0ab3a4f880a9 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:43:57.571776 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e77af2f8-4c87-42ff-9ab3-0ab3a4f880a9 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:43:57.572450 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e77af2f8-4c87-42ff-9ab3-0ab3a4f880a9 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:43:57.572893 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e77af2f8-4c87-42ff-9ab3-0ab3a4f880a9 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:43:57.573307 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-e77af2f8-4c87-42ff-9ab3-0ab3a4f880a9 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:43:57.700476 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-e77af2f8-4c87-42ff-9ab3-0ab3a4f880a9 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0500bcc4b18e4e2cab39fb3d867cce70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f344fdd32c8d482c8df161211d12fcd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:43:57.707939 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-e77af2f8-4c87-42ff-9ab3-0ab3a4f880a9 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] 10.222.0.17 "GET /compute/v2.1/servers/20d7f033-8d80-4f4c-89d4-76d92081a555" status: 200 len: 1454 microversion: 2.1 time: 0.148744 Aug 06 14:43:57.708507 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 599/1150] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:43:57 2022] GET /compute/v2.1/servers/20d7f033-8d80-4f4c-89d4-76d92081a555 => generated 1454 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:43:57.727548 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-3fdfc9bc-8586-4679-ab37-c76a70cbdac6 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:43:57.728155 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-3fdfc9bc-8586-4679-ab37-c76a70cbdac6 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] [instance: 20d7f033-8d80-4f4c-89d4-76d92081a555] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:43:57.735076 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3fdfc9bc-8586-4679-ab37-c76a70cbdac6 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:43:57.735554 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3fdfc9bc-8586-4679-ab37-c76a70cbdac6 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:43:57.735981 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3fdfc9bc-8586-4679-ab37-c76a70cbdac6 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:43:57.736661 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3fdfc9bc-8586-4679-ab37-c76a70cbdac6 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:43:57.737137 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3fdfc9bc-8586-4679-ab37-c76a70cbdac6 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:43:57.737556 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3fdfc9bc-8586-4679-ab37-c76a70cbdac6 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:43:57.869991 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-3fdfc9bc-8586-4679-ab37-c76a70cbdac6 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0500bcc4b18e4e2cab39fb3d867cce70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f344fdd32c8d482c8df161211d12fcd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:43:57.877700 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-3fdfc9bc-8586-4679-ab37-c76a70cbdac6 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] 10.222.0.17 "GET /compute/v2.1/servers/20d7f033-8d80-4f4c-89d4-76d92081a555" status: 200 len: 1454 microversion: 2.1 time: 0.153995 Aug 06 14:43:57.878255 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 552/1151] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:43:57 2022] GET /compute/v2.1/servers/20d7f033-8d80-4f4c-89d4-76d92081a555 => generated 1454 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:43:59.458675 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [req-4e81e964-bbba-45c2-91b9-583a0f6de472 req-0f31815c-af88-45a2-819a-0f52a0a18710 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20d7f033-8d80-4f4c-89d4-76d92081a555", "tag": "36ba90c5-56a8-41a5-94e3-70efe8df3203"}]} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:43:59.470254 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-4e81e964-bbba-45c2-91b9-583a0f6de472 req-0f31815c-af88-45a2-819a-0f52a0a18710 service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:43:59.471535 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-4e81e964-bbba-45c2-91b9-583a0f6de472 req-0f31815c-af88-45a2-819a-0f52a0a18710 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:43:59.472334 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-4e81e964-bbba-45c2-91b9-583a0f6de472 req-0f31815c-af88-45a2-819a-0f52a0a18710 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:43:59.484679 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.compute.server_external_events [req-4e81e964-bbba-45c2-91b9-583a0f6de472 req-0f31815c-af88-45a2-819a-0f52a0a18710 service nova] Creating event network-changed:36ba90c5-56a8-41a5-94e3-70efe8df3203 for instance 20d7f033-8d80-4f4c-89d4-76d92081a555 on hv-cinder-85199 Aug 06 14:43:59.489783 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [req-4e81e964-bbba-45c2-91b9-583a0f6de472 req-0f31815c-af88-45a2-819a-0f52a0a18710 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034891 Aug 06 14:43:59.490625 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 600/1152] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:43:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:45:03.176478 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 14:45:03.177165 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Sat Aug 6 14:45:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 14:45:17.914283 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 14:45:17.914856 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Sat Aug 6 14:45:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 14:45:59.963244 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c479aefb-aee2-478e-bd90-e3409c0feb3c] AMQP server on 10.222.0.17:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 06 14:45:59.963800 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:45:59.964547 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_cell1:SELECT=47 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:45:59.968599 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-cc636924-5803-49e7-b4a6-9bb61e9668c8 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:45:59.969127 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-cc636924-5803-49e7-b4a6-9bb61e9668c8 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] [instance: 84dcb712-de3a-419f-9412-c0372430e976] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:45:59.976485 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-cc636924-5803-49e7-b4a6-9bb61e9668c8 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:45:59.976961 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-cc636924-5803-49e7-b4a6-9bb61e9668c8 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:45:59.977386 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-cc636924-5803-49e7-b4a6-9bb61e9668c8 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:45:59.978064 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-cc636924-5803-49e7-b4a6-9bb61e9668c8 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:45:59.978507 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-cc636924-5803-49e7-b4a6-9bb61e9668c8 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:45:59.978980 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-cc636924-5803-49e7-b4a6-9bb61e9668c8 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:00.001644 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.objects.instance [None req-cc636924-5803-49e7-b4a6-9bb61e9668c8 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lazy-loading 'flavor' on Instance uuid 84dcb712-de3a-419f-9412-c0372430e976 {{(pid=117838) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 06 14:46:00.072801 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-cc636924-5803-49e7-b4a6-9bb61e9668c8 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] 10.222.0.17 "POST /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976/action" status: 202 len: 0 microversion: 2.1 time: 0.111476 Aug 06 14:46:00.073373 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 553/1153] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Aug 6 14:45:59 2022] POST /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 14:46:00.079736 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4dbc9f33-d8f9-45b7-a98f-7b46e4dddea2] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 06 14:46:00.080400 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_api:SELECT=17 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:46:00.081143 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_cell1:SELECT=50 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:46:00.085462 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-50d38614-16fa-438d-8831-8b27780ad92e tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:46:00.086167 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-50d38614-16fa-438d-8831-8b27780ad92e tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] [instance: 84dcb712-de3a-419f-9412-c0372430e976] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:46:00.093206 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-50d38614-16fa-438d-8831-8b27780ad92e tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:00.093687 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-50d38614-16fa-438d-8831-8b27780ad92e tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:00.094118 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-50d38614-16fa-438d-8831-8b27780ad92e tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:00.094889 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-50d38614-16fa-438d-8831-8b27780ad92e tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:00.095960 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-50d38614-16fa-438d-8831-8b27780ad92e tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:00.096386 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-50d38614-16fa-438d-8831-8b27780ad92e tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:00.279213 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-50d38614-16fa-438d-8831-8b27780ad92e tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164c1e7ad0a74e68b4f4cc4bb3eef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779be602b4054e6389c8ade7752e7ac2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:46:00.288140 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-50d38614-16fa-438d-8831-8b27780ad92e tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] 10.222.0.17 "GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976" status: 200 len: 1569 microversion: 2.1 time: 0.210197 Aug 06 14:46:00.288996 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 601/1154] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:46:00 2022] GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976 => generated 1569 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:46:01.310653 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-0423543d-caca-4191-961a-0db9dfd821a4 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:46:01.311636 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-0423543d-caca-4191-961a-0db9dfd821a4 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] [instance: 84dcb712-de3a-419f-9412-c0372430e976] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:46:01.318967 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0423543d-caca-4191-961a-0db9dfd821a4 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:01.319447 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0423543d-caca-4191-961a-0db9dfd821a4 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:01.319887 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0423543d-caca-4191-961a-0db9dfd821a4 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:01.320573 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0423543d-caca-4191-961a-0db9dfd821a4 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:01.321026 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0423543d-caca-4191-961a-0db9dfd821a4 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:01.321445 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0423543d-caca-4191-961a-0db9dfd821a4 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:01.326757 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO oslo.messaging._drivers.impl_rabbit [-] [c479aefb-aee2-478e-bd90-e3409c0feb3c] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 51980. Aug 06 14:46:01.504046 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-0423543d-caca-4191-961a-0db9dfd821a4 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164c1e7ad0a74e68b4f4cc4bb3eef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779be602b4054e6389c8ade7752e7ac2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:46:01.511608 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-0423543d-caca-4191-961a-0db9dfd821a4 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] 10.222.0.17 "GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976" status: 200 len: 1569 microversion: 2.1 time: 0.206151 Aug 06 14:46:01.512168 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 554/1155] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:46:01 2022] GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976 => generated 1569 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:46:02.532060 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-de49019c-533f-4c77-89c5-8a128e42a4cf tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:46:02.532719 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-de49019c-533f-4c77-89c5-8a128e42a4cf tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] [instance: 84dcb712-de3a-419f-9412-c0372430e976] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:46:02.542944 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO oslo.messaging._drivers.impl_rabbit [-] [4dbc9f33-d8f9-45b7-a98f-7b46e4dddea2] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 51988. Aug 06 14:46:02.546725 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-de49019c-533f-4c77-89c5-8a128e42a4cf tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:02.547236 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-de49019c-533f-4c77-89c5-8a128e42a4cf tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:02.547669 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-de49019c-533f-4c77-89c5-8a128e42a4cf tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:02.548841 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-de49019c-533f-4c77-89c5-8a128e42a4cf tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:02.549289 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-de49019c-533f-4c77-89c5-8a128e42a4cf tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:02.549708 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-de49019c-533f-4c77-89c5-8a128e42a4cf tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:02.678475 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-de49019c-533f-4c77-89c5-8a128e42a4cf tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164c1e7ad0a74e68b4f4cc4bb3eef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779be602b4054e6389c8ade7752e7ac2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:46:02.685955 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-de49019c-533f-4c77-89c5-8a128e42a4cf tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] 10.222.0.17 "GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976" status: 200 len: 1569 microversion: 2.1 time: 0.157763 Aug 06 14:46:02.686765 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 602/1156] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:46:02 2022] GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:46:03.707995 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-bbeb426b-6412-41de-9bf5-709f7581bec6 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:46:03.708550 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-bbeb426b-6412-41de-9bf5-709f7581bec6 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] [instance: 84dcb712-de3a-419f-9412-c0372430e976] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:46:03.714886 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-bbeb426b-6412-41de-9bf5-709f7581bec6 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:03.715387 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-bbeb426b-6412-41de-9bf5-709f7581bec6 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:03.715811 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-bbeb426b-6412-41de-9bf5-709f7581bec6 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:03.716497 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-bbeb426b-6412-41de-9bf5-709f7581bec6 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:03.716955 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-bbeb426b-6412-41de-9bf5-709f7581bec6 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:03.717373 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-bbeb426b-6412-41de-9bf5-709f7581bec6 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:03.851816 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-bbeb426b-6412-41de-9bf5-709f7581bec6 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164c1e7ad0a74e68b4f4cc4bb3eef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779be602b4054e6389c8ade7752e7ac2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:46:03.859325 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-bbeb426b-6412-41de-9bf5-709f7581bec6 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] 10.222.0.17 "GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976" status: 200 len: 1569 microversion: 2.1 time: 0.155824 Aug 06 14:46:03.859879 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 555/1157] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:46:03 2022] GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:46:04.879740 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-98f96a2b-aa05-44d5-aea6-9dbfb5a751e2 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:46:04.880347 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-98f96a2b-aa05-44d5-aea6-9dbfb5a751e2 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] [instance: 84dcb712-de3a-419f-9412-c0372430e976] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:46:04.886858 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-98f96a2b-aa05-44d5-aea6-9dbfb5a751e2 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:04.887363 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-98f96a2b-aa05-44d5-aea6-9dbfb5a751e2 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:04.887823 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-98f96a2b-aa05-44d5-aea6-9dbfb5a751e2 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:04.888501 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-98f96a2b-aa05-44d5-aea6-9dbfb5a751e2 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:04.888947 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-98f96a2b-aa05-44d5-aea6-9dbfb5a751e2 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:04.889368 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-98f96a2b-aa05-44d5-aea6-9dbfb5a751e2 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:05.018311 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-98f96a2b-aa05-44d5-aea6-9dbfb5a751e2 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164c1e7ad0a74e68b4f4cc4bb3eef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779be602b4054e6389c8ade7752e7ac2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:46:05.025891 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-98f96a2b-aa05-44d5-aea6-9dbfb5a751e2 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] 10.222.0.17 "GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976" status: 200 len: 1569 microversion: 2.1 time: 0.150083 Aug 06 14:46:05.026442 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 603/1158] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:46:04 2022] GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:46:06.047029 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-d8148f8a-51ce-43b0-869a-ebce5e9b064e tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:46:06.047637 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-d8148f8a-51ce-43b0-869a-ebce5e9b064e tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] [instance: 84dcb712-de3a-419f-9412-c0372430e976] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:46:06.054634 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d8148f8a-51ce-43b0-869a-ebce5e9b064e tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:06.055144 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d8148f8a-51ce-43b0-869a-ebce5e9b064e tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:06.055576 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d8148f8a-51ce-43b0-869a-ebce5e9b064e tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:06.056264 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d8148f8a-51ce-43b0-869a-ebce5e9b064e tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:06.056712 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d8148f8a-51ce-43b0-869a-ebce5e9b064e tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:06.057131 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d8148f8a-51ce-43b0-869a-ebce5e9b064e tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:06.193566 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-d8148f8a-51ce-43b0-869a-ebce5e9b064e tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164c1e7ad0a74e68b4f4cc4bb3eef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779be602b4054e6389c8ade7752e7ac2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:46:06.201274 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-d8148f8a-51ce-43b0-869a-ebce5e9b064e tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] 10.222.0.17 "GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976" status: 200 len: 1569 microversion: 2.1 time: 0.158175 Aug 06 14:46:06.201832 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 556/1159] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:46:06 2022] GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:46:07.221776 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-cff79f04-5d43-4b58-b551-2a00ef70c752 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:46:07.222427 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-cff79f04-5d43-4b58-b551-2a00ef70c752 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] [instance: 84dcb712-de3a-419f-9412-c0372430e976] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:46:07.228931 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-cff79f04-5d43-4b58-b551-2a00ef70c752 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:07.229411 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-cff79f04-5d43-4b58-b551-2a00ef70c752 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:07.229847 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-cff79f04-5d43-4b58-b551-2a00ef70c752 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:07.230531 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-cff79f04-5d43-4b58-b551-2a00ef70c752 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:07.231009 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-cff79f04-5d43-4b58-b551-2a00ef70c752 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:07.231431 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-cff79f04-5d43-4b58-b551-2a00ef70c752 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:07.360886 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-cff79f04-5d43-4b58-b551-2a00ef70c752 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164c1e7ad0a74e68b4f4cc4bb3eef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779be602b4054e6389c8ade7752e7ac2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:46:07.368982 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-cff79f04-5d43-4b58-b551-2a00ef70c752 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] 10.222.0.17 "GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976" status: 200 len: 1569 microversion: 2.1 time: 0.151331 Aug 06 14:46:07.369530 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 604/1160] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:46:07 2022] GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:46:08.389671 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-f38e0c5a-b8a9-42a5-b32c-36a9ad08ff84 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:46:08.390281 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-f38e0c5a-b8a9-42a5-b32c-36a9ad08ff84 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] [instance: 84dcb712-de3a-419f-9412-c0372430e976] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:46:08.397282 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f38e0c5a-b8a9-42a5-b32c-36a9ad08ff84 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:08.397763 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f38e0c5a-b8a9-42a5-b32c-36a9ad08ff84 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:08.398196 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f38e0c5a-b8a9-42a5-b32c-36a9ad08ff84 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:08.398898 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f38e0c5a-b8a9-42a5-b32c-36a9ad08ff84 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:08.399358 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f38e0c5a-b8a9-42a5-b32c-36a9ad08ff84 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:08.399783 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f38e0c5a-b8a9-42a5-b32c-36a9ad08ff84 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:08.526530 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-f38e0c5a-b8a9-42a5-b32c-36a9ad08ff84 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164c1e7ad0a74e68b4f4cc4bb3eef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779be602b4054e6389c8ade7752e7ac2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:46:08.533970 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-f38e0c5a-b8a9-42a5-b32c-36a9ad08ff84 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] 10.222.0.17 "GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976" status: 200 len: 1569 microversion: 2.1 time: 0.148218 Aug 06 14:46:08.534526 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 557/1161] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:46:08 2022] GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:46:09.553525 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-ecc584e8-baa1-4166-b9c3-11fece918f87 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:46:09.554119 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-ecc584e8-baa1-4166-b9c3-11fece918f87 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] [instance: 84dcb712-de3a-419f-9412-c0372430e976] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:46:09.560519 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ecc584e8-baa1-4166-b9c3-11fece918f87 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:09.560996 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ecc584e8-baa1-4166-b9c3-11fece918f87 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:09.561684 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ecc584e8-baa1-4166-b9c3-11fece918f87 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:09.562370 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ecc584e8-baa1-4166-b9c3-11fece918f87 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:09.562825 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ecc584e8-baa1-4166-b9c3-11fece918f87 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:09.563274 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-ecc584e8-baa1-4166-b9c3-11fece918f87 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:09.695266 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-ecc584e8-baa1-4166-b9c3-11fece918f87 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164c1e7ad0a74e68b4f4cc4bb3eef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779be602b4054e6389c8ade7752e7ac2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:46:09.702630 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-ecc584e8-baa1-4166-b9c3-11fece918f87 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] 10.222.0.17 "GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976" status: 200 len: 1569 microversion: 2.1 time: 0.153055 Aug 06 14:46:09.703215 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 605/1162] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:46:09 2022] GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:46:10.724360 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-d8f95d8e-6d49-40f1-bf43-4103e4ba60fc tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:46:10.724971 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-d8f95d8e-6d49-40f1-bf43-4103e4ba60fc tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] [instance: 84dcb712-de3a-419f-9412-c0372430e976] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:46:10.731483 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d8f95d8e-6d49-40f1-bf43-4103e4ba60fc tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:10.731960 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d8f95d8e-6d49-40f1-bf43-4103e4ba60fc tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:10.732386 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d8f95d8e-6d49-40f1-bf43-4103e4ba60fc tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:10.733071 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d8f95d8e-6d49-40f1-bf43-4103e4ba60fc tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:10.733533 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d8f95d8e-6d49-40f1-bf43-4103e4ba60fc tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:10.733939 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d8f95d8e-6d49-40f1-bf43-4103e4ba60fc tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:10.870428 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-d8f95d8e-6d49-40f1-bf43-4103e4ba60fc tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164c1e7ad0a74e68b4f4cc4bb3eef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779be602b4054e6389c8ade7752e7ac2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:46:10.878637 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-d8f95d8e-6d49-40f1-bf43-4103e4ba60fc tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] 10.222.0.17 "GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976" status: 200 len: 1569 microversion: 2.1 time: 0.158626 Aug 06 14:46:10.879349 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 558/1163] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:46:10 2022] GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:46:11.899782 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-2d005194-4afe-4f75-aea2-097d95a1b4c8 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:46:11.900387 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-2d005194-4afe-4f75-aea2-097d95a1b4c8 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] [instance: 84dcb712-de3a-419f-9412-c0372430e976] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:46:11.906735 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2d005194-4afe-4f75-aea2-097d95a1b4c8 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:11.907238 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2d005194-4afe-4f75-aea2-097d95a1b4c8 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:11.907665 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2d005194-4afe-4f75-aea2-097d95a1b4c8 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:11.908367 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2d005194-4afe-4f75-aea2-097d95a1b4c8 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:11.908818 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2d005194-4afe-4f75-aea2-097d95a1b4c8 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:11.909237 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2d005194-4afe-4f75-aea2-097d95a1b4c8 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:12.042221 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-2d005194-4afe-4f75-aea2-097d95a1b4c8 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164c1e7ad0a74e68b4f4cc4bb3eef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779be602b4054e6389c8ade7752e7ac2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:46:12.049667 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-2d005194-4afe-4f75-aea2-097d95a1b4c8 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] 10.222.0.17 "GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976" status: 200 len: 1569 microversion: 2.1 time: 0.153723 Aug 06 14:46:12.050218 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 606/1164] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:46:11 2022] GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:46:13.070409 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-a828775e-4898-4f75-9c15-12df0f38b758 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:46:13.071064 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-a828775e-4898-4f75-9c15-12df0f38b758 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] [instance: 84dcb712-de3a-419f-9412-c0372430e976] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:46:13.077436 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a828775e-4898-4f75-9c15-12df0f38b758 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:13.077937 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a828775e-4898-4f75-9c15-12df0f38b758 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:13.078353 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a828775e-4898-4f75-9c15-12df0f38b758 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:13.079133 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a828775e-4898-4f75-9c15-12df0f38b758 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:13.079585 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a828775e-4898-4f75-9c15-12df0f38b758 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:13.080497 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a828775e-4898-4f75-9c15-12df0f38b758 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:13.211993 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-a828775e-4898-4f75-9c15-12df0f38b758 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164c1e7ad0a74e68b4f4cc4bb3eef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779be602b4054e6389c8ade7752e7ac2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:46:13.219510 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-a828775e-4898-4f75-9c15-12df0f38b758 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] 10.222.0.17 "GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976" status: 200 len: 1570 microversion: 2.1 time: 0.153117 Aug 06 14:46:13.220090 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 559/1165] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:46:13 2022] GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:46:13.240153 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-c5603d7c-435a-4850-9cfb-3a92571dbe4e tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:46:13.240744 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-c5603d7c-435a-4850-9cfb-3a92571dbe4e tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] [instance: 84dcb712-de3a-419f-9412-c0372430e976] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:46:13.247025 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c5603d7c-435a-4850-9cfb-3a92571dbe4e tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:13.247500 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c5603d7c-435a-4850-9cfb-3a92571dbe4e tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:13.247922 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c5603d7c-435a-4850-9cfb-3a92571dbe4e tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:13.248599 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c5603d7c-435a-4850-9cfb-3a92571dbe4e tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:13.249042 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c5603d7c-435a-4850-9cfb-3a92571dbe4e tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:13.249456 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c5603d7c-435a-4850-9cfb-3a92571dbe4e tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:13.277612 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-c5603d7c-435a-4850-9cfb-3a92571dbe4e tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] [instance: 84dcb712-de3a-419f-9412-c0372430e976] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117837) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 06 14:46:13.342253 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-c5603d7c-435a-4850-9cfb-3a92571dbe4e tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] 10.222.0.17 "POST /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976/action" status: 202 len: 0 microversion: 2.1 time: 0.106067 Aug 06 14:46:13.342859 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 607/1166] 10.222.0.17 () {60 vars in 1278 bytes} [Sat Aug 6 14:46:13 2022] POST /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 14:46:13.351622 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-420314c1-dbaf-49ab-819c-f6846cb19fe7 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:46:13.352228 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-420314c1-dbaf-49ab-819c-f6846cb19fe7 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] [instance: 84dcb712-de3a-419f-9412-c0372430e976] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:46:13.358260 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-420314c1-dbaf-49ab-819c-f6846cb19fe7 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:13.359605 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-420314c1-dbaf-49ab-819c-f6846cb19fe7 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:13.360188 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-420314c1-dbaf-49ab-819c-f6846cb19fe7 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:13.360663 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-420314c1-dbaf-49ab-819c-f6846cb19fe7 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:13.361174 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-420314c1-dbaf-49ab-819c-f6846cb19fe7 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:13.361756 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-420314c1-dbaf-49ab-819c-f6846cb19fe7 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:13.539465 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-420314c1-dbaf-49ab-819c-f6846cb19fe7 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164c1e7ad0a74e68b4f4cc4bb3eef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779be602b4054e6389c8ade7752e7ac2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:46:13.547249 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-420314c1-dbaf-49ab-819c-f6846cb19fe7 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] 10.222.0.17 "GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976" status: 200 len: 1578 microversion: 2.1 time: 0.199416 Aug 06 14:46:13.547803 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 560/1167] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:46:13 2022] GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976 => generated 1578 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:46:14.568241 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-8e00ac67-6ca8-43ca-abd6-5079172e04a5 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:46:14.568858 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-8e00ac67-6ca8-43ca-abd6-5079172e04a5 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] [instance: 84dcb712-de3a-419f-9412-c0372430e976] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:46:14.574677 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8e00ac67-6ca8-43ca-abd6-5079172e04a5 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:14.575185 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8e00ac67-6ca8-43ca-abd6-5079172e04a5 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:14.575620 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8e00ac67-6ca8-43ca-abd6-5079172e04a5 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:14.576315 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8e00ac67-6ca8-43ca-abd6-5079172e04a5 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:14.576754 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8e00ac67-6ca8-43ca-abd6-5079172e04a5 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:14.577177 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-8e00ac67-6ca8-43ca-abd6-5079172e04a5 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:14.716404 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-8e00ac67-6ca8-43ca-abd6-5079172e04a5 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164c1e7ad0a74e68b4f4cc4bb3eef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779be602b4054e6389c8ade7752e7ac2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:46:14.724545 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-8e00ac67-6ca8-43ca-abd6-5079172e04a5 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] 10.222.0.17 "GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976" status: 200 len: 1520 microversion: 2.1 time: 0.160475 Aug 06 14:46:14.725109 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 608/1168] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:46:14 2022] GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:46:15.697039 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [req-1a86b113-08f2-4103-8774-e7d5a63a9973 req-ad730f08-cae4-4aa5-a16b-01fef102041a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84dcb712-de3a-419f-9412-c0372430e976", "name": "network-vif-unplugged", "status": "completed", "tag": "2bf6549d-c2c7-4ff1-8d53-d8423a286a3f"}]} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:46:15.708876 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-1a86b113-08f2-4103-8774-e7d5a63a9973 req-ad730f08-cae4-4aa5-a16b-01fef102041a service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:15.709403 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-1a86b113-08f2-4103-8774-e7d5a63a9973 req-ad730f08-cae4-4aa5-a16b-01fef102041a service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:15.709960 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-1a86b113-08f2-4103-8774-e7d5a63a9973 req-ad730f08-cae4-4aa5-a16b-01fef102041a service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:15.722409 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.compute.server_external_events [req-1a86b113-08f2-4103-8774-e7d5a63a9973 req-ad730f08-cae4-4aa5-a16b-01fef102041a service nova] Creating event network-vif-unplugged:2bf6549d-c2c7-4ff1-8d53-d8423a286a3f for instance 84dcb712-de3a-419f-9412-c0372430e976 on hv-cinder-85199 Aug 06 14:46:15.727519 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [req-1a86b113-08f2-4103-8774-e7d5a63a9973 req-ad730f08-cae4-4aa5-a16b-01fef102041a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034138 Aug 06 14:46:15.728105 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 561/1169] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:46:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:46:15.745362 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-9111cf26-bff3-4ce2-ade7-9545069f05ef tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:46:15.746053 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-9111cf26-bff3-4ce2-ade7-9545069f05ef tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] [instance: 84dcb712-de3a-419f-9412-c0372430e976] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:46:15.752457 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9111cf26-bff3-4ce2-ade7-9545069f05ef tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:15.753011 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9111cf26-bff3-4ce2-ade7-9545069f05ef tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:15.753447 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9111cf26-bff3-4ce2-ade7-9545069f05ef tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:15.754130 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9111cf26-bff3-4ce2-ade7-9545069f05ef tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:15.754579 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9111cf26-bff3-4ce2-ade7-9545069f05ef tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:15.755025 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9111cf26-bff3-4ce2-ade7-9545069f05ef tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:15.886991 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-9111cf26-bff3-4ce2-ade7-9545069f05ef tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164c1e7ad0a74e68b4f4cc4bb3eef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779be602b4054e6389c8ade7752e7ac2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:46:15.894409 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-9111cf26-bff3-4ce2-ade7-9545069f05ef tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] 10.222.0.17 "GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976" status: 200 len: 1576 microversion: 2.1 time: 0.152855 Aug 06 14:46:15.894989 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 609/1170] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:46:15 2022] GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:46:16.915513 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-7442d7b8-10ad-474e-a119-ff44ea4f7aaa tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:46:16.916209 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-7442d7b8-10ad-474e-a119-ff44ea4f7aaa tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] [instance: 84dcb712-de3a-419f-9412-c0372430e976] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:46:16.922945 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7442d7b8-10ad-474e-a119-ff44ea4f7aaa tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:16.923368 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7442d7b8-10ad-474e-a119-ff44ea4f7aaa tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:16.924297 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7442d7b8-10ad-474e-a119-ff44ea4f7aaa tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:16.924981 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7442d7b8-10ad-474e-a119-ff44ea4f7aaa tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:16.925433 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7442d7b8-10ad-474e-a119-ff44ea4f7aaa tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:16.925852 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-7442d7b8-10ad-474e-a119-ff44ea4f7aaa tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:16.930075 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-9b347a3b-25ab-4a52-901a-93e19a9709f9 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:46:16.930714 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-9b347a3b-25ab-4a52-901a-93e19a9709f9 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] [instance: 20d7f033-8d80-4f4c-89d4-76d92081a555] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:46:16.937295 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9b347a3b-25ab-4a52-901a-93e19a9709f9 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:16.937774 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9b347a3b-25ab-4a52-901a-93e19a9709f9 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:16.938208 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9b347a3b-25ab-4a52-901a-93e19a9709f9 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:16.938919 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9b347a3b-25ab-4a52-901a-93e19a9709f9 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:16.939969 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9b347a3b-25ab-4a52-901a-93e19a9709f9 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:16.940429 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-9b347a3b-25ab-4a52-901a-93e19a9709f9 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:16.964720 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-9b347a3b-25ab-4a52-901a-93e19a9709f9 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] [instance: 20d7f033-8d80-4f4c-89d4-76d92081a555] Going to try to terminate instance {{(pid=117837) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 14:46:17.024621 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9b347a3b-25ab-4a52-901a-93e19a9709f9 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] [ecb763d1-a179-4bb1-9348-38425accf918] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 06 14:46:17.061924 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-7442d7b8-10ad-474e-a119-ff44ea4f7aaa tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164c1e7ad0a74e68b4f4cc4bb3eef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779be602b4054e6389c8ade7752e7ac2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:46:17.070077 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-7442d7b8-10ad-474e-a119-ff44ea4f7aaa tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] 10.222.0.17 "GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976" status: 200 len: 1576 microversion: 2.1 time: 0.158806 Aug 06 14:46:17.070647 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 562/1171] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:46:16 2022] GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:46:18.031496 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO oslo.messaging._drivers.impl_rabbit [None req-9b347a3b-25ab-4a52-901a-93e19a9709f9 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] [ecb763d1-a179-4bb1-9348-38425accf918] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 52040. Aug 06 14:46:18.050824 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-9b347a3b-25ab-4a52-901a-93e19a9709f9 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] 10.222.0.17 "DELETE /compute/v2.1/servers/20d7f033-8d80-4f4c-89d4-76d92081a555" status: 204 len: 0 microversion: 2.1 time: 1.124476 Aug 06 14:46:18.051546 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 610/1172] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Aug 6 14:46:16 2022] DELETE /compute/v2.1/servers/20d7f033-8d80-4f4c-89d4-76d92081a555 => generated 0 bytes in 1126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 06 14:46:18.059556 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-f94cdd47-60e8-4dcc-89a1-c8b7e61210a9 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:46:18.060168 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-f94cdd47-60e8-4dcc-89a1-c8b7e61210a9 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] [instance: 20d7f033-8d80-4f4c-89d4-76d92081a555] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:46:18.067301 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f94cdd47-60e8-4dcc-89a1-c8b7e61210a9 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:18.067781 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f94cdd47-60e8-4dcc-89a1-c8b7e61210a9 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:18.068218 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f94cdd47-60e8-4dcc-89a1-c8b7e61210a9 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:18.068904 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f94cdd47-60e8-4dcc-89a1-c8b7e61210a9 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:18.069354 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f94cdd47-60e8-4dcc-89a1-c8b7e61210a9 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:18.069776 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f94cdd47-60e8-4dcc-89a1-c8b7e61210a9 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:18.091281 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-fd0f7310-d68b-40d3-b127-84bf0bfc2d0b tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:46:18.091967 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-fd0f7310-d68b-40d3-b127-84bf0bfc2d0b tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] [instance: 84dcb712-de3a-419f-9412-c0372430e976] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:46:18.098550 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-fd0f7310-d68b-40d3-b127-84bf0bfc2d0b tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:18.098977 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-fd0f7310-d68b-40d3-b127-84bf0bfc2d0b tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:18.099406 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-fd0f7310-d68b-40d3-b127-84bf0bfc2d0b tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:18.100081 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-fd0f7310-d68b-40d3-b127-84bf0bfc2d0b tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:18.100523 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-fd0f7310-d68b-40d3-b127-84bf0bfc2d0b tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:18.100937 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-fd0f7310-d68b-40d3-b127-84bf0bfc2d0b tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:18.202678 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-f94cdd47-60e8-4dcc-89a1-c8b7e61210a9 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0500bcc4b18e4e2cab39fb3d867cce70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f344fdd32c8d482c8df161211d12fcd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:46:18.210817 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-f94cdd47-60e8-4dcc-89a1-c8b7e61210a9 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] 10.222.0.17 "GET /compute/v2.1/servers/20d7f033-8d80-4f4c-89d4-76d92081a555" status: 200 len: 1579 microversion: 2.1 time: 0.155092 Aug 06 14:46:18.211991 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 563/1173] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:46:18 2022] GET /compute/v2.1/servers/20d7f033-8d80-4f4c-89d4-76d92081a555 => generated 1579 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:46:18.232669 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-fd0f7310-d68b-40d3-b127-84bf0bfc2d0b tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164c1e7ad0a74e68b4f4cc4bb3eef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779be602b4054e6389c8ade7752e7ac2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:46:18.240598 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-fd0f7310-d68b-40d3-b127-84bf0bfc2d0b tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] 10.222.0.17 "GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976" status: 200 len: 1576 microversion: 2.1 time: 0.153596 Aug 06 14:46:18.241154 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 611/1174] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:46:18 2022] GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:46:19.231465 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-91c92569-7c0e-4e42-83eb-234a7bcf932e tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:46:19.232077 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-91c92569-7c0e-4e42-83eb-234a7bcf932e tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] [instance: 20d7f033-8d80-4f4c-89d4-76d92081a555] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:46:19.238945 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-91c92569-7c0e-4e42-83eb-234a7bcf932e tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:19.239424 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-91c92569-7c0e-4e42-83eb-234a7bcf932e tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:19.239860 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-91c92569-7c0e-4e42-83eb-234a7bcf932e tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:19.240544 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-91c92569-7c0e-4e42-83eb-234a7bcf932e tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:19.240995 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-91c92569-7c0e-4e42-83eb-234a7bcf932e tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:19.241416 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-91c92569-7c0e-4e42-83eb-234a7bcf932e tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:19.261968 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-c56a1ddc-f755-4163-83ed-218c4d01dfb7 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:46:19.262572 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-c56a1ddc-f755-4163-83ed-218c4d01dfb7 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] [instance: 84dcb712-de3a-419f-9412-c0372430e976] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:46:19.268837 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c56a1ddc-f755-4163-83ed-218c4d01dfb7 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:19.269315 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c56a1ddc-f755-4163-83ed-218c4d01dfb7 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:19.269750 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c56a1ddc-f755-4163-83ed-218c4d01dfb7 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:19.270440 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c56a1ddc-f755-4163-83ed-218c4d01dfb7 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:19.270907 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c56a1ddc-f755-4163-83ed-218c4d01dfb7 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:19.271338 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c56a1ddc-f755-4163-83ed-218c4d01dfb7 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:19.374391 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-91c92569-7c0e-4e42-83eb-234a7bcf932e tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0500bcc4b18e4e2cab39fb3d867cce70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f344fdd32c8d482c8df161211d12fcd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:46:19.381849 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-91c92569-7c0e-4e42-83eb-234a7bcf932e tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] 10.222.0.17 "GET /compute/v2.1/servers/20d7f033-8d80-4f4c-89d4-76d92081a555" status: 200 len: 1579 microversion: 2.1 time: 0.154271 Aug 06 14:46:19.382410 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 564/1175] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:46:19 2022] GET /compute/v2.1/servers/20d7f033-8d80-4f4c-89d4-76d92081a555 => generated 1579 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:46:19.407051 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-c56a1ddc-f755-4163-83ed-218c4d01dfb7 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164c1e7ad0a74e68b4f4cc4bb3eef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779be602b4054e6389c8ade7752e7ac2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:46:19.415150 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-c56a1ddc-f755-4163-83ed-218c4d01dfb7 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] 10.222.0.17 "GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976" status: 200 len: 1576 microversion: 2.1 time: 0.157590 Aug 06 14:46:19.415707 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 612/1176] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:46:19 2022] GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:46:20.403019 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-240cbd24-ca6a-4672-89b0-b2ac16afff8c tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:46:20.403714 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-240cbd24-ca6a-4672-89b0-b2ac16afff8c tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] [instance: 20d7f033-8d80-4f4c-89d4-76d92081a555] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:46:20.410321 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-240cbd24-ca6a-4672-89b0-b2ac16afff8c tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:20.410808 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-240cbd24-ca6a-4672-89b0-b2ac16afff8c tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:20.411281 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-240cbd24-ca6a-4672-89b0-b2ac16afff8c tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:20.411977 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-240cbd24-ca6a-4672-89b0-b2ac16afff8c tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:20.412434 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-240cbd24-ca6a-4672-89b0-b2ac16afff8c tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:20.412856 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-240cbd24-ca6a-4672-89b0-b2ac16afff8c tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:20.436576 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-c99f85e7-7b51-4817-b34f-aab6ad6bd3d4 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:46:20.437180 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-c99f85e7-7b51-4817-b34f-aab6ad6bd3d4 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] [instance: 84dcb712-de3a-419f-9412-c0372430e976] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:46:20.445228 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c99f85e7-7b51-4817-b34f-aab6ad6bd3d4 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:20.445987 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c99f85e7-7b51-4817-b34f-aab6ad6bd3d4 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:20.446628 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c99f85e7-7b51-4817-b34f-aab6ad6bd3d4 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:20.447552 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c99f85e7-7b51-4817-b34f-aab6ad6bd3d4 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:20.448202 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c99f85e7-7b51-4817-b34f-aab6ad6bd3d4 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:20.448818 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-c99f85e7-7b51-4817-b34f-aab6ad6bd3d4 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:20.479743 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-240cbd24-ca6a-4672-89b0-b2ac16afff8c tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0500bcc4b18e4e2cab39fb3d867cce70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f344fdd32c8d482c8df161211d12fcd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:46:20.488366 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-240cbd24-ca6a-4672-89b0-b2ac16afff8c tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] 10.222.0.17 "GET /compute/v2.1/servers/20d7f033-8d80-4f4c-89d4-76d92081a555" status: 200 len: 1511 microversion: 2.1 time: 0.088821 Aug 06 14:46:20.489000 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 565/1177] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:46:20 2022] GET /compute/v2.1/servers/20d7f033-8d80-4f4c-89d4-76d92081a555 => generated 1511 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:46:20.668726 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-c99f85e7-7b51-4817-b34f-aab6ad6bd3d4 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164c1e7ad0a74e68b4f4cc4bb3eef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779be602b4054e6389c8ade7752e7ac2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:46:20.676761 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-c99f85e7-7b51-4817-b34f-aab6ad6bd3d4 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] 10.222.0.17 "GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976" status: 200 len: 1576 microversion: 2.1 time: 0.244203 Aug 06 14:46:20.690061 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 613/1178] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:46:20 2022] GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976 => generated 1576 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:46:20.805264 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [req-bd9781f7-469a-4861-a7f1-94b62e3fc74a req-81146e15-9e5a-43d8-9111-1708ccbc3957 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20d7f033-8d80-4f4c-89d4-76d92081a555", "name": "network-vif-deleted", "tag": "36ba90c5-56a8-41a5-94e3-70efe8df3203"}]} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:46:20.821063 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-bd9781f7-469a-4861-a7f1-94b62e3fc74a req-81146e15-9e5a-43d8-9111-1708ccbc3957 service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:20.821834 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-bd9781f7-469a-4861-a7f1-94b62e3fc74a req-81146e15-9e5a-43d8-9111-1708ccbc3957 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:20.823157 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-bd9781f7-469a-4861-a7f1-94b62e3fc74a req-81146e15-9e5a-43d8-9111-1708ccbc3957 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:20.837614 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.compute.server_external_events [req-bd9781f7-469a-4861-a7f1-94b62e3fc74a req-81146e15-9e5a-43d8-9111-1708ccbc3957 service nova] Creating event network-vif-deleted:36ba90c5-56a8-41a5-94e3-70efe8df3203 for instance 20d7f033-8d80-4f4c-89d4-76d92081a555 on hv-cinder-85199 Aug 06 14:46:20.843221 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [req-bd9781f7-469a-4861-a7f1-94b62e3fc74a req-81146e15-9e5a-43d8-9111-1708ccbc3957 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111630 Aug 06 14:46:20.844364 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 566/1179] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:46:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:46:21.509226 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-869f2dd2-66b4-4b70-803b-8b8a4e9c43e3 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:46:21.509867 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-869f2dd2-66b4-4b70-803b-8b8a4e9c43e3 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] [instance: 20d7f033-8d80-4f4c-89d4-76d92081a555] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:46:21.516436 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-869f2dd2-66b4-4b70-803b-8b8a4e9c43e3 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:21.516931 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-869f2dd2-66b4-4b70-803b-8b8a4e9c43e3 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:21.517341 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-869f2dd2-66b4-4b70-803b-8b8a4e9c43e3 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:21.518109 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-869f2dd2-66b4-4b70-803b-8b8a4e9c43e3 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:21.518642 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-869f2dd2-66b4-4b70-803b-8b8a4e9c43e3 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:21.519467 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-869f2dd2-66b4-4b70-803b-8b8a4e9c43e3 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:21.533544 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.wsgi [None req-869f2dd2-66b4-4b70-803b-8b8a4e9c43e3 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] HTTP exception thrown: Instance 20d7f033-8d80-4f4c-89d4-76d92081a555 could not be found. Aug 06 14:46:21.535958 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-869f2dd2-66b4-4b70-803b-8b8a4e9c43e3 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Request method failure captured: Aug 06 14:46:21.535958 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: request: GET /compute/v2.1/servers/20d7f033-8d80-4f4c-89d4-76d92081a555 HTTP/1.1 Aug 06 14:46:21.535958 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Accept: application/json Aug 06 14:46:21.535958 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Accept-Encoding: identity Aug 06 14:46:21.535958 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Connection: close Aug 06 14:46:21.535958 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Content-Length: 0 Aug 06 14:46:21.535958 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Content-Type: application/json Aug 06 14:46:21.535958 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Host: 10.222.0.17 Aug 06 14:46:21.535958 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Openstack-System-Scope: None Aug 06 14:46:21.535958 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: User-Agent: python-urllib3/1.26.11 Aug 06 14:46:21.535958 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Auth-Token: gAAAAABi7n38WKmQYcvLHWr8GzZ9dMEpVf8eK3oj3NaBuFcy3UU1iwmUOZ72YxufI1B1CvqtE8i-rBoW78fNzACCLFXwfEy-YrDIBlKWE09lHwqY0hz3Ij_0uAM_igWrO1N2NEI9Pb9zn1EwnzIwoR6NeQfg_tOCe9GVK72MxuG6ZqLh1-Zympo Aug 06 14:46:21.535958 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Domain-Id: None Aug 06 14:46:21.535958 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Domain-Name: None Aug 06 14:46:21.535958 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Identity-Status: Confirmed Aug 06 14:46:21.535958 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Is-Admin-Project: True Aug 06 14:46:21.535958 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Domain-Id: default Aug 06 14:46:21.535958 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Domain-Name: Default Aug 06 14:46:21.535958 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Id: f344fdd32c8d482c8df161211d12fcd6 Aug 06 14:46:21.535958 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Name: tempest-TestVolumeBootPattern-1969510220 Aug 06 14:46:21.535958 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Role: member,reader Aug 06 14:46:21.535958 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Roles: member,reader Aug 06 14:46:21.537808 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f344fdd32c8d482c8df161211d12fcd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f344fdd32c8d482c8df161211d12fcd6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f344fdd32c8d482c8df161211d12fcd6", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f344fdd32c8d482c8df161211d12fcd6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 06 14:46:21.537808 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant: tempest-TestVolumeBootPattern-1969510220 Aug 06 14:46:21.537808 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant-Id: f344fdd32c8d482c8df161211d12fcd6 Aug 06 14:46:21.537808 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant-Name: tempest-TestVolumeBootPattern-1969510220 Aug 06 14:46:21.537808 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User: tempest-TestVolumeBootPattern-1969510220-project Aug 06 14:46:21.537808 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Domain-Id: default Aug 06 14:46:21.537808 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Domain-Name: Default Aug 06 14:46:21.537808 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Id: 0500bcc4b18e4e2cab39fb3d867cce70 Aug 06 14:46:21.537808 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Name: tempest-TestVolumeBootPattern-1969510220-project Aug 06 14:46:21.537808 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: method: > Aug 06 14:46:21.537808 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: exception: Instance 20d7f033-8d80-4f4c-89d4-76d92081a555 could not be found. Aug 06 14:46:21.537808 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: action_args: {'id': '20d7f033-8d80-4f4c-89d4-76d92081a555'} Aug 06 14:46:21.538821 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 14:46:21.538821 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:46:21.538821 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 14:46:21.538821 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 14:46:21.538821 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 14:46:21.538821 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 14:46:21.538821 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 14:46:21.538821 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 14:46:21.538821 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 14:46:21.538821 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 14:46:21.538821 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20d7f033-8d80-4f4c-89d4-76d92081a555 could not be found. Aug 06 14:46:21.538821 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:46:21.538821 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:46:21.538821 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:46:21.538821 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:46:21.538821 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:46:21.538821 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:46:21.538821 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 14:46:21.538821 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 14:46:21.538821 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 14:46:21.540633 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 14:46:21.540633 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 14:46:21.540633 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 14:46:21.540633 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 14:46:21.540633 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 14:46:21.540633 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 14:46:21.540633 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 14:46:21.540633 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20d7f033-8d80-4f4c-89d4-76d92081a555 could not be found. Aug 06 14:46:21.540633 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:46:21.540633 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:46:21.540633 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:46:21.540633 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:46:21.540633 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:46:21.540633 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:46:21.540633 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 14:46:21.540633 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 14:46:21.540633 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20d7f033-8d80-4f4c-89d4-76d92081a555 could not be found. Aug 06 14:46:21.540633 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:46:21.542148 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-869f2dd2-66b4-4b70-803b-8b8a4e9c43e3 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Returning 404 to user: Instance 20d7f033-8d80-4f4c-89d4-76d92081a555 could not be found. {{(pid=117837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 14:46:21.542148 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-869f2dd2-66b4-4b70-803b-8b8a4e9c43e3 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] 10.222.0.17 "GET /compute/v2.1/servers/20d7f033-8d80-4f4c-89d4-76d92081a555" status: 404 len: 111 microversion: 2.1 time: 0.032051 Aug 06 14:46:21.542148 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 614/1180] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:46:21 2022] GET /compute/v2.1/servers/20d7f033-8d80-4f4c-89d4-76d92081a555 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 14:46:21.587618 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-789eaa61-150a-48a5-949b-e6e7946d7359 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-819150784", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-603286594", "security_groups": [{"name": "tempest-secgroup-smoke-1234795654"}], "block_device_mapping_v2": [{"uuid": "b45a6eb0-80fb-43f3-9b6f-a8fc8d0dfb00", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "75577732-bec1-435e-9165-942aae4827a6"}]}} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:46:21.698825 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-64d4250c-5875-4f01-966a-ff11e53b254c tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:46:21.699522 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-64d4250c-5875-4f01-966a-ff11e53b254c tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] [instance: 84dcb712-de3a-419f-9412-c0372430e976] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:46:21.705888 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-64d4250c-5875-4f01-966a-ff11e53b254c tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:21.706430 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-64d4250c-5875-4f01-966a-ff11e53b254c tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:21.707392 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-64d4250c-5875-4f01-966a-ff11e53b254c tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:21.708088 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-64d4250c-5875-4f01-966a-ff11e53b254c tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:21.708535 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-64d4250c-5875-4f01-966a-ff11e53b254c tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:21.708956 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-64d4250c-5875-4f01-966a-ff11e53b254c tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:21.710862 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.network.neutron [None req-789eaa61-150a-48a5-949b-e6e7946d7359 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] validate_networks() for [('75577732-bec1-435e-9165-942aae4827a6', None, None, None, None, None)] {{(pid=117838) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 14:46:21.732225 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:46:21.851936 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-64d4250c-5875-4f01-966a-ff11e53b254c tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164c1e7ad0a74e68b4f4cc4bb3eef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779be602b4054e6389c8ade7752e7ac2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:46:21.859499 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-64d4250c-5875-4f01-966a-ff11e53b254c tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] 10.222.0.17 "GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976" status: 200 len: 1576 microversion: 2.1 time: 0.165188 Aug 06 14:46:21.860064 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 615/1181] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:46:21 2022] GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976 => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:46:22.089444 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.virt.hardware [None req-789eaa61-150a-48a5-949b-e6e7946d7359 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Flavor limits 0:0:0 {{(pid=117838) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 14:46:22.089863 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.virt.hardware [None req-789eaa61-150a-48a5-949b-e6e7946d7359 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Image limits 0:0:0 {{(pid=117838) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 14:46:22.090332 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.virt.hardware [None req-789eaa61-150a-48a5-949b-e6e7946d7359 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Flavor pref 0:0:0 {{(pid=117838) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 14:46:22.090758 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.virt.hardware [None req-789eaa61-150a-48a5-949b-e6e7946d7359 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Image pref 0:0:0 {{(pid=117838) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 14:46:22.091189 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.virt.hardware [None req-789eaa61-150a-48a5-949b-e6e7946d7359 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117838) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 14:46:22.099791 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-789eaa61-150a-48a5-949b-e6e7946d7359 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:22.100214 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-789eaa61-150a-48a5-949b-e6e7946d7359 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:22.100643 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-789eaa61-150a-48a5-949b-e6e7946d7359 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:22.101352 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-789eaa61-150a-48a5-949b-e6e7946d7359 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:22.101799 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-789eaa61-150a-48a5-949b-e6e7946d7359 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:22.102219 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-789eaa61-150a-48a5-949b-e6e7946d7359 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:22.118970 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.quota [None req-789eaa61-150a-48a5-949b-e6e7946d7359 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Getting quotas for project f344fdd32c8d482c8df161211d12fcd6. Resources: {'cores', 'instances', 'ram'} {{(pid=117838) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 14:46:22.122825 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.quota [None req-789eaa61-150a-48a5-949b-e6e7946d7359 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Getting quotas for user 0500bcc4b18e4e2cab39fb3d867cce70 and project f344fdd32c8d482c8df161211d12fcd6. Resources: {'cores', 'instances', 'ram'} {{(pid=117838) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 14:46:22.178860 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-789eaa61-150a-48a5-949b-e6e7946d7359 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Going to run 1 instances... {{(pid=117838) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 14:46:22.181047 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-789eaa61-150a-48a5-949b-e6e7946d7359 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] [instance: d8a79e24-ca9d-4be2-8988-4daac9ecb9d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b45a6eb0-80fb-43f3-9b6f-a8fc8d0dfb00',volume_size=None,volume_type=None)] {{(pid=117838) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 14:46:22.305125 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-789eaa61-150a-48a5-949b-e6e7946d7359 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.722252 Aug 06 14:46:22.305767 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 567/1182] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Aug 6 14:46:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 06 14:46:22.317409 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-e8d25024-5830-4885-971f-061093a1b5d2 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:46:22.318018 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-e8d25024-5830-4885-971f-061093a1b5d2 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] [instance: d8a79e24-ca9d-4be2-8988-4daac9ecb9d7] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:46:22.373042 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-e8d25024-5830-4885-971f-061093a1b5d2 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0500bcc4b18e4e2cab39fb3d867cce70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f344fdd32c8d482c8df161211d12fcd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:46:22.379681 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-e8d25024-5830-4885-971f-061093a1b5d2 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] 10.222.0.17 "GET /compute/v2.1/servers/d8a79e24-ca9d-4be2-8988-4daac9ecb9d7" status: 200 len: 1093 microversion: 2.1 time: 0.066896 Aug 06 14:46:22.380231 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 616/1183] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:46:22 2022] GET /compute/v2.1/servers/d8a79e24-ca9d-4be2-8988-4daac9ecb9d7 => generated 1093 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:46:22.881003 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-5cfcf17b-e131-47c7-925d-b12f5e50e84d tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:46:22.881615 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-5cfcf17b-e131-47c7-925d-b12f5e50e84d tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] [instance: 84dcb712-de3a-419f-9412-c0372430e976] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:46:22.888422 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5cfcf17b-e131-47c7-925d-b12f5e50e84d tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:22.888904 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5cfcf17b-e131-47c7-925d-b12f5e50e84d tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:22.889336 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5cfcf17b-e131-47c7-925d-b12f5e50e84d tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:22.890027 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5cfcf17b-e131-47c7-925d-b12f5e50e84d tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:22.890478 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5cfcf17b-e131-47c7-925d-b12f5e50e84d tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:22.890919 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-5cfcf17b-e131-47c7-925d-b12f5e50e84d tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:23.017577 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-5cfcf17b-e131-47c7-925d-b12f5e50e84d tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164c1e7ad0a74e68b4f4cc4bb3eef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779be602b4054e6389c8ade7752e7ac2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:46:23.025450 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-5cfcf17b-e131-47c7-925d-b12f5e50e84d tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] 10.222.0.17 "GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976" status: 200 len: 1576 microversion: 2.1 time: 0.148924 Aug 06 14:46:23.026015 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 568/1184] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:46:22 2022] GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976 => generated 1576 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:46:23.399725 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-f752fe19-6f79-4bc7-ac1d-3ed318d65d7e tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:46:23.400339 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-f752fe19-6f79-4bc7-ac1d-3ed318d65d7e tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] [instance: d8a79e24-ca9d-4be2-8988-4daac9ecb9d7] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:46:23.451448 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-f752fe19-6f79-4bc7-ac1d-3ed318d65d7e tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0500bcc4b18e4e2cab39fb3d867cce70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f344fdd32c8d482c8df161211d12fcd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:46:23.459100 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-f752fe19-6f79-4bc7-ac1d-3ed318d65d7e tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] 10.222.0.17 "GET /compute/v2.1/servers/d8a79e24-ca9d-4be2-8988-4daac9ecb9d7" status: 200 len: 1093 microversion: 2.1 time: 0.063123 Aug 06 14:46:23.459640 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 617/1185] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:46:23 2022] GET /compute/v2.1/servers/d8a79e24-ca9d-4be2-8988-4daac9ecb9d7 => generated 1093 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:46:24.046486 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-f0af8d76-af59-4d8c-ab61-28f30f38d13e tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:46:24.047125 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-f0af8d76-af59-4d8c-ab61-28f30f38d13e tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] [instance: 84dcb712-de3a-419f-9412-c0372430e976] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:46:24.054168 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f0af8d76-af59-4d8c-ab61-28f30f38d13e tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:24.054650 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f0af8d76-af59-4d8c-ab61-28f30f38d13e tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:24.055191 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f0af8d76-af59-4d8c-ab61-28f30f38d13e tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:24.055881 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f0af8d76-af59-4d8c-ab61-28f30f38d13e tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:24.056334 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f0af8d76-af59-4d8c-ab61-28f30f38d13e tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:24.056756 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-f0af8d76-af59-4d8c-ab61-28f30f38d13e tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:24.075279 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:46:24.191325 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-f0af8d76-af59-4d8c-ab61-28f30f38d13e tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164c1e7ad0a74e68b4f4cc4bb3eef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779be602b4054e6389c8ade7752e7ac2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:46:24.199677 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-f0af8d76-af59-4d8c-ab61-28f30f38d13e tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] 10.222.0.17 "GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976" status: 200 len: 1576 microversion: 2.1 time: 0.156975 Aug 06 14:46:24.200262 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 569/1186] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:46:24 2022] GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:46:24.479243 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-e4104599-d3a9-4b5d-a27a-944fb6296220 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:46:24.480057 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-e4104599-d3a9-4b5d-a27a-944fb6296220 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] [instance: d8a79e24-ca9d-4be2-8988-4daac9ecb9d7] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:46:24.532032 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-e4104599-d3a9-4b5d-a27a-944fb6296220 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0500bcc4b18e4e2cab39fb3d867cce70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f344fdd32c8d482c8df161211d12fcd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:46:24.540203 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-e4104599-d3a9-4b5d-a27a-944fb6296220 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] 10.222.0.17 "GET /compute/v2.1/servers/d8a79e24-ca9d-4be2-8988-4daac9ecb9d7" status: 200 len: 1093 microversion: 2.1 time: 0.064908 Aug 06 14:46:24.540778 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 618/1187] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:46:24 2022] GET /compute/v2.1/servers/d8a79e24-ca9d-4be2-8988-4daac9ecb9d7 => generated 1093 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:46:25.221166 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-ac9b479f-335b-42f9-90e4-b0d841a4904b tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:46:25.221795 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-ac9b479f-335b-42f9-90e4-b0d841a4904b tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] [instance: 84dcb712-de3a-419f-9412-c0372430e976] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:46:25.228708 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ac9b479f-335b-42f9-90e4-b0d841a4904b tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:25.229179 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ac9b479f-335b-42f9-90e4-b0d841a4904b tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:25.229603 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ac9b479f-335b-42f9-90e4-b0d841a4904b tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:25.230279 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ac9b479f-335b-42f9-90e4-b0d841a4904b tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:25.230723 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ac9b479f-335b-42f9-90e4-b0d841a4904b tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:25.231163 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-ac9b479f-335b-42f9-90e4-b0d841a4904b tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:25.364566 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-ac9b479f-335b-42f9-90e4-b0d841a4904b tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164c1e7ad0a74e68b4f4cc4bb3eef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779be602b4054e6389c8ade7752e7ac2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:46:25.371956 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-ac9b479f-335b-42f9-90e4-b0d841a4904b tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] 10.222.0.17 "GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976" status: 200 len: 1563 microversion: 2.1 time: 0.154616 Aug 06 14:46:25.372508 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 570/1188] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:46:25 2022] GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976 => generated 1563 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:46:25.561768 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-9601968f-a022-41d4-8891-4ed39b6a5b60 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:46:25.562301 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-9601968f-a022-41d4-8891-4ed39b6a5b60 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] [instance: d8a79e24-ca9d-4be2-8988-4daac9ecb9d7] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:46:25.619127 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-9601968f-a022-41d4-8891-4ed39b6a5b60 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0500bcc4b18e4e2cab39fb3d867cce70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f344fdd32c8d482c8df161211d12fcd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:46:25.627381 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-9601968f-a022-41d4-8891-4ed39b6a5b60 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] 10.222.0.17 "GET /compute/v2.1/servers/d8a79e24-ca9d-4be2-8988-4daac9ecb9d7" status: 200 len: 1093 microversion: 2.1 time: 0.069406 Aug 06 14:46:25.628906 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 619/1189] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:46:25 2022] GET /compute/v2.1/servers/d8a79e24-ca9d-4be2-8988-4daac9ecb9d7 => generated 1093 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:46:25.798694 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [req-9d77d7cf-7bd5-4282-bdb7-1ccd6583bf6d req-396c0780-4e98-4eab-9aa7-3a61b9f7b6c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84dcb712-de3a-419f-9412-c0372430e976", "name": "network-vif-plugged", "status": "completed", "tag": "2bf6549d-c2c7-4ff1-8d53-d8423a286a3f"}]} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:46:25.809426 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-9d77d7cf-7bd5-4282-bdb7-1ccd6583bf6d req-396c0780-4e98-4eab-9aa7-3a61b9f7b6c9 service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:25.809914 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-9d77d7cf-7bd5-4282-bdb7-1ccd6583bf6d req-396c0780-4e98-4eab-9aa7-3a61b9f7b6c9 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:25.810347 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-9d77d7cf-7bd5-4282-bdb7-1ccd6583bf6d req-396c0780-4e98-4eab-9aa7-3a61b9f7b6c9 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:25.823456 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.compute.server_external_events [req-9d77d7cf-7bd5-4282-bdb7-1ccd6583bf6d req-396c0780-4e98-4eab-9aa7-3a61b9f7b6c9 service nova] Creating event network-vif-plugged:2bf6549d-c2c7-4ff1-8d53-d8423a286a3f for instance 84dcb712-de3a-419f-9412-c0372430e976 on hv-cinder-85199 Aug 06 14:46:25.828754 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [req-9d77d7cf-7bd5-4282-bdb7-1ccd6583bf6d req-396c0780-4e98-4eab-9aa7-3a61b9f7b6c9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034169 Aug 06 14:46:25.829371 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 571/1190] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:46:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:46:26.648652 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-66c9d2fa-0a35-4ac3-b6c8-298813d19233 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:46:26.649272 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-66c9d2fa-0a35-4ac3-b6c8-298813d19233 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] [instance: d8a79e24-ca9d-4be2-8988-4daac9ecb9d7] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:46:26.655719 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-66c9d2fa-0a35-4ac3-b6c8-298813d19233 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:26.656196 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-66c9d2fa-0a35-4ac3-b6c8-298813d19233 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:26.656632 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-66c9d2fa-0a35-4ac3-b6c8-298813d19233 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:26.657319 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-66c9d2fa-0a35-4ac3-b6c8-298813d19233 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:26.657772 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-66c9d2fa-0a35-4ac3-b6c8-298813d19233 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:26.658195 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-66c9d2fa-0a35-4ac3-b6c8-298813d19233 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:26.716999 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-66c9d2fa-0a35-4ac3-b6c8-298813d19233 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0500bcc4b18e4e2cab39fb3d867cce70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f344fdd32c8d482c8df161211d12fcd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:46:26.724326 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-66c9d2fa-0a35-4ac3-b6c8-298813d19233 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] 10.222.0.17 "GET /compute/v2.1/servers/d8a79e24-ca9d-4be2-8988-4daac9ecb9d7" status: 200 len: 1143 microversion: 2.1 time: 0.079532 Aug 06 14:46:26.724892 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 620/1191] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:46:26 2022] GET /compute/v2.1/servers/d8a79e24-ca9d-4be2-8988-4daac9ecb9d7 => generated 1143 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:46:27.746236 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-83121710-45e7-4400-ad9c-2800f3f839e5 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:46:27.746951 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-83121710-45e7-4400-ad9c-2800f3f839e5 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] [instance: d8a79e24-ca9d-4be2-8988-4daac9ecb9d7] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:46:27.752995 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-83121710-45e7-4400-ad9c-2800f3f839e5 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:27.753970 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-83121710-45e7-4400-ad9c-2800f3f839e5 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:27.754397 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-83121710-45e7-4400-ad9c-2800f3f839e5 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:27.755097 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-83121710-45e7-4400-ad9c-2800f3f839e5 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:27.755546 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-83121710-45e7-4400-ad9c-2800f3f839e5 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:27.755961 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-83121710-45e7-4400-ad9c-2800f3f839e5 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:27.819159 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-83121710-45e7-4400-ad9c-2800f3f839e5 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0500bcc4b18e4e2cab39fb3d867cce70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f344fdd32c8d482c8df161211d12fcd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:46:27.826893 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-83121710-45e7-4400-ad9c-2800f3f839e5 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] 10.222.0.17 "GET /compute/v2.1/servers/d8a79e24-ca9d-4be2-8988-4daac9ecb9d7" status: 200 len: 1209 microversion: 2.1 time: 0.085392 Aug 06 14:46:27.827570 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 572/1192] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:46:27 2022] GET /compute/v2.1/servers/d8a79e24-ca9d-4be2-8988-4daac9ecb9d7 => generated 1209 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:46:28.856654 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-f3ad99dc-b276-4124-9d2c-be13b7ec0b27 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:46:28.859470 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-f3ad99dc-b276-4124-9d2c-be13b7ec0b27 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] [instance: d8a79e24-ca9d-4be2-8988-4daac9ecb9d7] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:46:28.871353 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f3ad99dc-b276-4124-9d2c-be13b7ec0b27 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:28.871954 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f3ad99dc-b276-4124-9d2c-be13b7ec0b27 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:28.872575 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f3ad99dc-b276-4124-9d2c-be13b7ec0b27 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:28.873344 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f3ad99dc-b276-4124-9d2c-be13b7ec0b27 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:28.873862 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f3ad99dc-b276-4124-9d2c-be13b7ec0b27 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:28.874379 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-f3ad99dc-b276-4124-9d2c-be13b7ec0b27 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:28.989150 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [req-10d0d88e-ea1b-49a0-81c4-00970936e35b req-b3fd2a6d-def6-43c4-a387-5077bb510b04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8a79e24-ca9d-4be2-8988-4daac9ecb9d7", "tag": "6a832a1f-ed35-4400-a6d9-8bc4d3860594"}]} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:46:28.999244 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-10d0d88e-ea1b-49a0-81c4-00970936e35b req-b3fd2a6d-def6-43c4-a387-5077bb510b04 service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:28.999738 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-10d0d88e-ea1b-49a0-81c4-00970936e35b req-b3fd2a6d-def6-43c4-a387-5077bb510b04 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:29.000172 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-10d0d88e-ea1b-49a0-81c4-00970936e35b req-b3fd2a6d-def6-43c4-a387-5077bb510b04 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:29.012490 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.compute.server_external_events [req-10d0d88e-ea1b-49a0-81c4-00970936e35b req-b3fd2a6d-def6-43c4-a387-5077bb510b04 service nova] Creating event network-changed:6a832a1f-ed35-4400-a6d9-8bc4d3860594 for instance d8a79e24-ca9d-4be2-8988-4daac9ecb9d7 on hv-cinder-85199 Aug 06 14:46:29.017689 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [req-10d0d88e-ea1b-49a0-81c4-00970936e35b req-b3fd2a6d-def6-43c4-a387-5077bb510b04 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032839 Aug 06 14:46:29.018573 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 573/1193] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:46:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 14:46:29.108375 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-f3ad99dc-b276-4124-9d2c-be13b7ec0b27 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0500bcc4b18e4e2cab39fb3d867cce70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f344fdd32c8d482c8df161211d12fcd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:46:29.116067 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-f3ad99dc-b276-4124-9d2c-be13b7ec0b27 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] 10.222.0.17 "GET /compute/v2.1/servers/d8a79e24-ca9d-4be2-8988-4daac9ecb9d7" status: 200 len: 1265 microversion: 2.1 time: 0.271258 Aug 06 14:46:29.116630 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 621/1194] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:46:28 2022] GET /compute/v2.1/servers/d8a79e24-ca9d-4be2-8988-4daac9ecb9d7 => generated 1265 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:46:30.137487 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-9f6d4ce7-46fb-4d10-8790-9a4154fa51d6 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:46:30.138186 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-9f6d4ce7-46fb-4d10-8790-9a4154fa51d6 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] [instance: d8a79e24-ca9d-4be2-8988-4daac9ecb9d7] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:46:30.140606 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:46:30.146059 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9f6d4ce7-46fb-4d10-8790-9a4154fa51d6 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:30.146536 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9f6d4ce7-46fb-4d10-8790-9a4154fa51d6 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:30.146999 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9f6d4ce7-46fb-4d10-8790-9a4154fa51d6 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:30.147685 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9f6d4ce7-46fb-4d10-8790-9a4154fa51d6 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:30.148135 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9f6d4ce7-46fb-4d10-8790-9a4154fa51d6 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:30.148558 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9f6d4ce7-46fb-4d10-8790-9a4154fa51d6 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:30.281983 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-9f6d4ce7-46fb-4d10-8790-9a4154fa51d6 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0500bcc4b18e4e2cab39fb3d867cce70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f344fdd32c8d482c8df161211d12fcd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:46:30.293989 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-9f6d4ce7-46fb-4d10-8790-9a4154fa51d6 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] 10.222.0.17 "GET /compute/v2.1/servers/d8a79e24-ca9d-4be2-8988-4daac9ecb9d7" status: 200 len: 1265 microversion: 2.1 time: 0.160655 Aug 06 14:46:30.294577 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 574/1195] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:46:30 2022] GET /compute/v2.1/servers/d8a79e24-ca9d-4be2-8988-4daac9ecb9d7 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:46:31.314346 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-85527454-edbf-4a6c-9990-c456fbc21940 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:46:31.315025 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-85527454-edbf-4a6c-9990-c456fbc21940 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] [instance: d8a79e24-ca9d-4be2-8988-4daac9ecb9d7] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:46:31.318026 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:46:31.323635 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-85527454-edbf-4a6c-9990-c456fbc21940 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:31.324109 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-85527454-edbf-4a6c-9990-c456fbc21940 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:31.324540 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-85527454-edbf-4a6c-9990-c456fbc21940 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:31.325228 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-85527454-edbf-4a6c-9990-c456fbc21940 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:31.325674 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-85527454-edbf-4a6c-9990-c456fbc21940 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:31.326091 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-85527454-edbf-4a6c-9990-c456fbc21940 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:31.461453 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-85527454-edbf-4a6c-9990-c456fbc21940 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0500bcc4b18e4e2cab39fb3d867cce70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f344fdd32c8d482c8df161211d12fcd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:46:31.468815 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-85527454-edbf-4a6c-9990-c456fbc21940 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] 10.222.0.17 "GET /compute/v2.1/servers/d8a79e24-ca9d-4be2-8988-4daac9ecb9d7" status: 200 len: 1265 microversion: 2.1 time: 0.158552 Aug 06 14:46:31.469407 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 622/1196] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:46:31 2022] GET /compute/v2.1/servers/d8a79e24-ca9d-4be2-8988-4daac9ecb9d7 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:46:32.490028 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-1bb36350-5a29-430a-a29b-63564856568e tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:46:32.490630 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-1bb36350-5a29-430a-a29b-63564856568e tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] [instance: d8a79e24-ca9d-4be2-8988-4daac9ecb9d7] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:46:32.492588 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_cell0:SELECT=2 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:46:32.493231 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_cell0:SELECT=6 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:46:32.499058 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1bb36350-5a29-430a-a29b-63564856568e tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:32.499534 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1bb36350-5a29-430a-a29b-63564856568e tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:32.499960 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1bb36350-5a29-430a-a29b-63564856568e tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:32.500641 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1bb36350-5a29-430a-a29b-63564856568e tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:32.501087 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1bb36350-5a29-430a-a29b-63564856568e tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:32.501503 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1bb36350-5a29-430a-a29b-63564856568e tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:32.627252 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-1bb36350-5a29-430a-a29b-63564856568e tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0500bcc4b18e4e2cab39fb3d867cce70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f344fdd32c8d482c8df161211d12fcd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:46:32.635345 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-1bb36350-5a29-430a-a29b-63564856568e tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] 10.222.0.17 "GET /compute/v2.1/servers/d8a79e24-ca9d-4be2-8988-4daac9ecb9d7" status: 200 len: 1265 microversion: 2.1 time: 0.149288 Aug 06 14:46:32.635907 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 575/1197] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:46:32 2022] GET /compute/v2.1/servers/d8a79e24-ca9d-4be2-8988-4daac9ecb9d7 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:46:33.656725 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-b8ab39a6-1820-48e6-920d-78c10d0cb1d5 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:46:33.657332 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-b8ab39a6-1820-48e6-920d-78c10d0cb1d5 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] [instance: d8a79e24-ca9d-4be2-8988-4daac9ecb9d7] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:46:33.663957 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b8ab39a6-1820-48e6-920d-78c10d0cb1d5 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:33.664430 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b8ab39a6-1820-48e6-920d-78c10d0cb1d5 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:33.664855 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b8ab39a6-1820-48e6-920d-78c10d0cb1d5 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:33.665529 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b8ab39a6-1820-48e6-920d-78c10d0cb1d5 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:33.665975 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b8ab39a6-1820-48e6-920d-78c10d0cb1d5 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:33.666393 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b8ab39a6-1820-48e6-920d-78c10d0cb1d5 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:33.793672 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-b8ab39a6-1820-48e6-920d-78c10d0cb1d5 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0500bcc4b18e4e2cab39fb3d867cce70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f344fdd32c8d482c8df161211d12fcd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:46:33.801561 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-b8ab39a6-1820-48e6-920d-78c10d0cb1d5 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] 10.222.0.17 "GET /compute/v2.1/servers/d8a79e24-ca9d-4be2-8988-4daac9ecb9d7" status: 200 len: 1265 microversion: 2.1 time: 0.148714 Aug 06 14:46:33.802107 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 623/1198] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:46:33 2022] GET /compute/v2.1/servers/d8a79e24-ca9d-4be2-8988-4daac9ecb9d7 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:46:34.822600 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-a3591da8-16b0-41e8-9458-58537cef374e tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:46:34.823232 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-a3591da8-16b0-41e8-9458-58537cef374e tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] [instance: d8a79e24-ca9d-4be2-8988-4daac9ecb9d7] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:46:34.829611 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a3591da8-16b0-41e8-9458-58537cef374e tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:34.830082 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a3591da8-16b0-41e8-9458-58537cef374e tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:34.830527 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a3591da8-16b0-41e8-9458-58537cef374e tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:34.831246 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a3591da8-16b0-41e8-9458-58537cef374e tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:34.831688 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a3591da8-16b0-41e8-9458-58537cef374e tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:34.832106 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a3591da8-16b0-41e8-9458-58537cef374e tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:34.962293 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-a3591da8-16b0-41e8-9458-58537cef374e tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0500bcc4b18e4e2cab39fb3d867cce70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f344fdd32c8d482c8df161211d12fcd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:46:34.969800 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-a3591da8-16b0-41e8-9458-58537cef374e tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] 10.222.0.17 "GET /compute/v2.1/servers/d8a79e24-ca9d-4be2-8988-4daac9ecb9d7" status: 200 len: 1265 microversion: 2.1 time: 0.151013 Aug 06 14:46:34.970358 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 576/1199] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:46:34 2022] GET /compute/v2.1/servers/d8a79e24-ca9d-4be2-8988-4daac9ecb9d7 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:46:35.989584 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-cdff4b90-4949-4d31-beb8-86484bd6ea05 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:46:35.990186 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-cdff4b90-4949-4d31-beb8-86484bd6ea05 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] [instance: d8a79e24-ca9d-4be2-8988-4daac9ecb9d7] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:46:35.992478 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_cell0:SELECT=8 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:46:35.997856 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-cdff4b90-4949-4d31-beb8-86484bd6ea05 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:35.998338 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-cdff4b90-4949-4d31-beb8-86484bd6ea05 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:35.998768 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-cdff4b90-4949-4d31-beb8-86484bd6ea05 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:35.999504 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-cdff4b90-4949-4d31-beb8-86484bd6ea05 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:35.999957 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-cdff4b90-4949-4d31-beb8-86484bd6ea05 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:36.000382 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-cdff4b90-4949-4d31-beb8-86484bd6ea05 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:36.132697 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-cdff4b90-4949-4d31-beb8-86484bd6ea05 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0500bcc4b18e4e2cab39fb3d867cce70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f344fdd32c8d482c8df161211d12fcd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:46:36.140028 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-cdff4b90-4949-4d31-beb8-86484bd6ea05 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] 10.222.0.17 "GET /compute/v2.1/servers/d8a79e24-ca9d-4be2-8988-4daac9ecb9d7" status: 200 len: 1265 microversion: 2.1 time: 0.154393 Aug 06 14:46:36.140580 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 624/1200] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:46:35 2022] GET /compute/v2.1/servers/d8a79e24-ca9d-4be2-8988-4daac9ecb9d7 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:46:37.161528 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-e7b92b52-d20a-4a04-809c-e48e53fedc29 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:46:37.162137 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-e7b92b52-d20a-4a04-809c-e48e53fedc29 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] [instance: d8a79e24-ca9d-4be2-8988-4daac9ecb9d7] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:46:37.168605 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e7b92b52-d20a-4a04-809c-e48e53fedc29 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:37.169078 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e7b92b52-d20a-4a04-809c-e48e53fedc29 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:37.169504 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e7b92b52-d20a-4a04-809c-e48e53fedc29 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:37.170185 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e7b92b52-d20a-4a04-809c-e48e53fedc29 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:37.170632 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e7b92b52-d20a-4a04-809c-e48e53fedc29 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:37.171080 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-e7b92b52-d20a-4a04-809c-e48e53fedc29 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:37.304893 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-e7b92b52-d20a-4a04-809c-e48e53fedc29 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0500bcc4b18e4e2cab39fb3d867cce70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f344fdd32c8d482c8df161211d12fcd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:46:37.312795 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-e7b92b52-d20a-4a04-809c-e48e53fedc29 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] 10.222.0.17 "GET /compute/v2.1/servers/d8a79e24-ca9d-4be2-8988-4daac9ecb9d7" status: 200 len: 1265 microversion: 2.1 time: 0.155720 Aug 06 14:46:37.313351 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 577/1201] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:46:37 2022] GET /compute/v2.1/servers/d8a79e24-ca9d-4be2-8988-4daac9ecb9d7 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:46:38.333478 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-0ac002eb-f86b-4581-bc24-608e7c0d02dd tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:46:38.334703 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-0ac002eb-f86b-4581-bc24-608e7c0d02dd tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] [instance: d8a79e24-ca9d-4be2-8988-4daac9ecb9d7] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:46:38.341552 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0ac002eb-f86b-4581-bc24-608e7c0d02dd tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:38.342028 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0ac002eb-f86b-4581-bc24-608e7c0d02dd tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:38.342459 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0ac002eb-f86b-4581-bc24-608e7c0d02dd tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:38.343172 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0ac002eb-f86b-4581-bc24-608e7c0d02dd tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:38.343600 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0ac002eb-f86b-4581-bc24-608e7c0d02dd tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:38.344020 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0ac002eb-f86b-4581-bc24-608e7c0d02dd tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:38.476957 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-0ac002eb-f86b-4581-bc24-608e7c0d02dd tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0500bcc4b18e4e2cab39fb3d867cce70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f344fdd32c8d482c8df161211d12fcd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:46:38.484308 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-0ac002eb-f86b-4581-bc24-608e7c0d02dd tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] 10.222.0.17 "GET /compute/v2.1/servers/d8a79e24-ca9d-4be2-8988-4daac9ecb9d7" status: 200 len: 1265 microversion: 2.1 time: 0.154623 Aug 06 14:46:38.484877 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 625/1202] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:46:38 2022] GET /compute/v2.1/servers/d8a79e24-ca9d-4be2-8988-4daac9ecb9d7 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:46:39.505300 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-49a1c60e-09cf-44fc-af7e-72e654daeec1 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:46:39.505900 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-49a1c60e-09cf-44fc-af7e-72e654daeec1 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] [instance: d8a79e24-ca9d-4be2-8988-4daac9ecb9d7] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:46:39.512288 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-49a1c60e-09cf-44fc-af7e-72e654daeec1 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:39.512765 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-49a1c60e-09cf-44fc-af7e-72e654daeec1 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:39.513197 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-49a1c60e-09cf-44fc-af7e-72e654daeec1 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:39.513871 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-49a1c60e-09cf-44fc-af7e-72e654daeec1 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:39.514313 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-49a1c60e-09cf-44fc-af7e-72e654daeec1 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:39.514727 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-49a1c60e-09cf-44fc-af7e-72e654daeec1 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:39.650850 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-49a1c60e-09cf-44fc-af7e-72e654daeec1 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0500bcc4b18e4e2cab39fb3d867cce70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f344fdd32c8d482c8df161211d12fcd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:46:39.658252 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-49a1c60e-09cf-44fc-af7e-72e654daeec1 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] 10.222.0.17 "GET /compute/v2.1/servers/d8a79e24-ca9d-4be2-8988-4daac9ecb9d7" status: 200 len: 1265 microversion: 2.1 time: 0.157391 Aug 06 14:46:39.658817 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 578/1203] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:46:39 2022] GET /compute/v2.1/servers/d8a79e24-ca9d-4be2-8988-4daac9ecb9d7 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:46:39.903087 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [req-0445d694-9d62-4826-9674-741b1d6b0bcd req-59e2b223-050d-4a97-ac5b-ac5913776364 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8a79e24-ca9d-4be2-8988-4daac9ecb9d7", "name": "network-vif-plugged", "status": "completed", "tag": "6a832a1f-ed35-4400-a6d9-8bc4d3860594"}]} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:46:39.913578 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-0445d694-9d62-4826-9674-741b1d6b0bcd req-59e2b223-050d-4a97-ac5b-ac5913776364 service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:39.914085 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-0445d694-9d62-4826-9674-741b1d6b0bcd req-59e2b223-050d-4a97-ac5b-ac5913776364 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:39.914484 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-0445d694-9d62-4826-9674-741b1d6b0bcd req-59e2b223-050d-4a97-ac5b-ac5913776364 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:39.925971 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.compute.server_external_events [req-0445d694-9d62-4826-9674-741b1d6b0bcd req-59e2b223-050d-4a97-ac5b-ac5913776364 service nova] Creating event network-vif-plugged:6a832a1f-ed35-4400-a6d9-8bc4d3860594 for instance d8a79e24-ca9d-4be2-8988-4daac9ecb9d7 on hv-cinder-85199 Aug 06 14:46:39.930811 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [req-0445d694-9d62-4826-9674-741b1d6b0bcd req-59e2b223-050d-4a97-ac5b-ac5913776364 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031476 Aug 06 14:46:39.931425 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 626/1204] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:46:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 14:46:40.679646 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-846ac318-a3a7-486b-ad5a-2569e5847d22 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:46:40.680293 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-846ac318-a3a7-486b-ad5a-2569e5847d22 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] [instance: d8a79e24-ca9d-4be2-8988-4daac9ecb9d7] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:46:40.686897 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-846ac318-a3a7-486b-ad5a-2569e5847d22 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:40.687382 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-846ac318-a3a7-486b-ad5a-2569e5847d22 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:40.687842 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-846ac318-a3a7-486b-ad5a-2569e5847d22 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:40.688523 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-846ac318-a3a7-486b-ad5a-2569e5847d22 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:40.688971 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-846ac318-a3a7-486b-ad5a-2569e5847d22 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:40.689393 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-846ac318-a3a7-486b-ad5a-2569e5847d22 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:40.815556 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-846ac318-a3a7-486b-ad5a-2569e5847d22 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0500bcc4b18e4e2cab39fb3d867cce70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f344fdd32c8d482c8df161211d12fcd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:46:40.823253 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-846ac318-a3a7-486b-ad5a-2569e5847d22 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] 10.222.0.17 "GET /compute/v2.1/servers/d8a79e24-ca9d-4be2-8988-4daac9ecb9d7" status: 200 len: 1265 microversion: 2.1 time: 0.147413 Aug 06 14:46:40.823865 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 579/1205] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:46:40 2022] GET /compute/v2.1/servers/d8a79e24-ca9d-4be2-8988-4daac9ecb9d7 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:46:41.845389 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-b193ffef-d0ad-4ed9-87df-546eecd4a4b4 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:46:41.846219 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-b193ffef-d0ad-4ed9-87df-546eecd4a4b4 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] [instance: d8a79e24-ca9d-4be2-8988-4daac9ecb9d7] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:46:41.852658 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b193ffef-d0ad-4ed9-87df-546eecd4a4b4 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:41.853141 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b193ffef-d0ad-4ed9-87df-546eecd4a4b4 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:41.853572 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b193ffef-d0ad-4ed9-87df-546eecd4a4b4 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:41.854266 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b193ffef-d0ad-4ed9-87df-546eecd4a4b4 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:41.854720 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b193ffef-d0ad-4ed9-87df-546eecd4a4b4 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:41.855166 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b193ffef-d0ad-4ed9-87df-546eecd4a4b4 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:41.985996 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-b193ffef-d0ad-4ed9-87df-546eecd4a4b4 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0500bcc4b18e4e2cab39fb3d867cce70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f344fdd32c8d482c8df161211d12fcd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:46:41.993652 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-b193ffef-d0ad-4ed9-87df-546eecd4a4b4 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] 10.222.0.17 "GET /compute/v2.1/servers/d8a79e24-ca9d-4be2-8988-4daac9ecb9d7" status: 200 len: 1452 microversion: 2.1 time: 0.152983 Aug 06 14:46:41.994231 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 627/1206] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:46:41 2022] GET /compute/v2.1/servers/d8a79e24-ca9d-4be2-8988-4daac9ecb9d7 => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:46:42.018217 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-1856d2d0-07e7-490f-b174-4f718e323963 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:46:42.020016 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-1856d2d0-07e7-490f-b174-4f718e323963 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] [instance: d8a79e24-ca9d-4be2-8988-4daac9ecb9d7] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:46:42.026710 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1856d2d0-07e7-490f-b174-4f718e323963 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:42.027226 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1856d2d0-07e7-490f-b174-4f718e323963 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:42.027671 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1856d2d0-07e7-490f-b174-4f718e323963 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:42.028370 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1856d2d0-07e7-490f-b174-4f718e323963 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:42.028818 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1856d2d0-07e7-490f-b174-4f718e323963 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:42.029260 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-1856d2d0-07e7-490f-b174-4f718e323963 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:42.158005 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-1856d2d0-07e7-490f-b174-4f718e323963 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0500bcc4b18e4e2cab39fb3d867cce70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f344fdd32c8d482c8df161211d12fcd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:46:42.165502 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-1856d2d0-07e7-490f-b174-4f718e323963 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] 10.222.0.17 "GET /compute/v2.1/servers/d8a79e24-ca9d-4be2-8988-4daac9ecb9d7" status: 200 len: 1452 microversion: 2.1 time: 0.151336 Aug 06 14:46:42.166060 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 580/1207] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:46:42 2022] GET /compute/v2.1/servers/d8a79e24-ca9d-4be2-8988-4daac9ecb9d7 => generated 1452 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 06 14:46:43.962927 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [req-38b7b07b-58fc-46fd-a6df-0fd310080546 req-d36ce6ef-102a-433a-8f28-c7ce2ea5f78c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8a79e24-ca9d-4be2-8988-4daac9ecb9d7", "tag": "6a832a1f-ed35-4400-a6d9-8bc4d3860594"}]} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:46:43.973151 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-38b7b07b-58fc-46fd-a6df-0fd310080546 req-d36ce6ef-102a-433a-8f28-c7ce2ea5f78c service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:46:43.973620 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-38b7b07b-58fc-46fd-a6df-0fd310080546 req-d36ce6ef-102a-433a-8f28-c7ce2ea5f78c service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:46:43.974044 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-38b7b07b-58fc-46fd-a6df-0fd310080546 req-d36ce6ef-102a-433a-8f28-c7ce2ea5f78c service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:46:43.984790 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.compute.server_external_events [req-38b7b07b-58fc-46fd-a6df-0fd310080546 req-d36ce6ef-102a-433a-8f28-c7ce2ea5f78c service nova] Creating event network-changed:6a832a1f-ed35-4400-a6d9-8bc4d3860594 for instance d8a79e24-ca9d-4be2-8988-4daac9ecb9d7 on hv-cinder-85199 Aug 06 14:46:43.990438 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [req-38b7b07b-58fc-46fd-a6df-0fd310080546 req-d36ce6ef-102a-433a-8f28-c7ce2ea5f78c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031170 Aug 06 14:46:43.991052 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 628/1208] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:46:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:48:02.889782 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_api:SELECT=13 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:48:02.890737 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_cell1:SELECT=60 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:48:02.892882 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_api:SELECT=13 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:48:02.895158 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_cell1:SELECT=48 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:48:02.895548 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-a32ac3a9-0c57-47a9-968e-736177ee61bf tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:48:02.896047 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-a32ac3a9-0c57-47a9-968e-736177ee61bf tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] [instance: 84dcb712-de3a-419f-9412-c0372430e976] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:48:02.900314 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [req-d23dc289-1097-4f9f-8fef-ff77717aa9df req-dff5aa2d-7ab4-476a-a5d5-4c540d097312 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84dcb712-de3a-419f-9412-c0372430e976", "tag": "2bf6549d-c2c7-4ff1-8d53-d8423a286a3f"}]} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:48:02.902905 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a32ac3a9-0c57-47a9-968e-736177ee61bf tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:48:02.903401 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a32ac3a9-0c57-47a9-968e-736177ee61bf tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:48:02.903985 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a32ac3a9-0c57-47a9-968e-736177ee61bf tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:48:02.904695 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a32ac3a9-0c57-47a9-968e-736177ee61bf tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:48:02.905151 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a32ac3a9-0c57-47a9-968e-736177ee61bf tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:48:02.905571 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-a32ac3a9-0c57-47a9-968e-736177ee61bf tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:48:02.912693 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-d23dc289-1097-4f9f-8fef-ff77717aa9df req-dff5aa2d-7ab4-476a-a5d5-4c540d097312 service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:48:02.913176 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-d23dc289-1097-4f9f-8fef-ff77717aa9df req-dff5aa2d-7ab4-476a-a5d5-4c540d097312 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:48:02.913608 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-d23dc289-1097-4f9f-8fef-ff77717aa9df req-dff5aa2d-7ab4-476a-a5d5-4c540d097312 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:48:02.926676 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.compute.server_external_events [req-d23dc289-1097-4f9f-8fef-ff77717aa9df req-dff5aa2d-7ab4-476a-a5d5-4c540d097312 service nova] Creating event network-changed:2bf6549d-c2c7-4ff1-8d53-d8423a286a3f for instance 84dcb712-de3a-419f-9412-c0372430e976 on hv-cinder-85199 Aug 06 14:48:02.931859 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [req-d23dc289-1097-4f9f-8fef-ff77717aa9df req-dff5aa2d-7ab4-476a-a5d5-4c540d097312 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041739 Aug 06 14:48:02.932013 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-a32ac3a9-0c57-47a9-968e-736177ee61bf tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] [instance: 84dcb712-de3a-419f-9412-c0372430e976] Going to try to terminate instance {{(pid=117838) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 14:48:02.932534 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 629/1209] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:48:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 14:48:03.011849 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-a32ac3a9-0c57-47a9-968e-736177ee61bf tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] 10.222.0.17 "DELETE /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976" status: 204 len: 0 microversion: 2.1 time: 0.123973 Aug 06 14:48:03.012914 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 581/1210] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Aug 6 14:48:02 2022] DELETE /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 06 14:48:03.022753 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-4f053527-5530-4072-93d8-fcdd10181259 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:48:03.023959 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-4f053527-5530-4072-93d8-fcdd10181259 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] [instance: 84dcb712-de3a-419f-9412-c0372430e976] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:48:03.033065 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-4f053527-5530-4072-93d8-fcdd10181259 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:48:03.034289 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-4f053527-5530-4072-93d8-fcdd10181259 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:48:03.034710 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-4f053527-5530-4072-93d8-fcdd10181259 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:48:03.035658 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-4f053527-5530-4072-93d8-fcdd10181259 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:48:03.036116 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-4f053527-5530-4072-93d8-fcdd10181259 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:48:03.036729 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-4f053527-5530-4072-93d8-fcdd10181259 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:48:03.170998 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-4f053527-5530-4072-93d8-fcdd10181259 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164c1e7ad0a74e68b4f4cc4bb3eef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779be602b4054e6389c8ade7752e7ac2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:48:03.182690 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-4f053527-5530-4072-93d8-fcdd10181259 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] 10.222.0.17 "GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976" status: 200 len: 1569 microversion: 2.1 time: 0.164582 Aug 06 14:48:03.183924 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 630/1211] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:48:03 2022] GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:48:04.206889 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-9c914cb5-e71b-46c1-897e-0accdb605333 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:48:04.207661 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-9c914cb5-e71b-46c1-897e-0accdb605333 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] [instance: 84dcb712-de3a-419f-9412-c0372430e976] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:48:04.214186 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9c914cb5-e71b-46c1-897e-0accdb605333 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:48:04.214667 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9c914cb5-e71b-46c1-897e-0accdb605333 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:48:04.215146 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9c914cb5-e71b-46c1-897e-0accdb605333 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:48:04.215839 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9c914cb5-e71b-46c1-897e-0accdb605333 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:48:04.216293 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9c914cb5-e71b-46c1-897e-0accdb605333 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:48:04.216717 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-9c914cb5-e71b-46c1-897e-0accdb605333 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:48:04.352901 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-9c914cb5-e71b-46c1-897e-0accdb605333 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164c1e7ad0a74e68b4f4cc4bb3eef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779be602b4054e6389c8ade7752e7ac2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:48:04.360687 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-9c914cb5-e71b-46c1-897e-0accdb605333 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] 10.222.0.17 "GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976" status: 200 len: 1569 microversion: 2.1 time: 0.158521 Aug 06 14:48:04.361258 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 582/1212] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:48:04 2022] GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:48:05.381344 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-397d80d0-2f9d-4ee8-ae6e-4edd3ca32547 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:48:05.381959 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-397d80d0-2f9d-4ee8-ae6e-4edd3ca32547 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] [instance: 84dcb712-de3a-419f-9412-c0372430e976] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:48:05.388320 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-397d80d0-2f9d-4ee8-ae6e-4edd3ca32547 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:48:05.388804 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-397d80d0-2f9d-4ee8-ae6e-4edd3ca32547 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:48:05.389237 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-397d80d0-2f9d-4ee8-ae6e-4edd3ca32547 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:48:05.389928 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-397d80d0-2f9d-4ee8-ae6e-4edd3ca32547 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:48:05.390383 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-397d80d0-2f9d-4ee8-ae6e-4edd3ca32547 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:48:05.390810 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-397d80d0-2f9d-4ee8-ae6e-4edd3ca32547 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:48:05.476934 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-397d80d0-2f9d-4ee8-ae6e-4edd3ca32547 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '164c1e7ad0a74e68b4f4cc4bb3eef50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '779be602b4054e6389c8ade7752e7ac2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:48:05.485341 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-397d80d0-2f9d-4ee8-ae6e-4edd3ca32547 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] 10.222.0.17 "GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976" status: 200 len: 1382 microversion: 2.1 time: 0.107871 Aug 06 14:48:05.485999 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 631/1213] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:48:05 2022] GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976 => generated 1382 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:48:05.536797 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [req-2ae9378c-4445-48cf-bccd-a7c6ecb369ea req-c2592b72-b0d8-4e6a-88ca-36f33ce89f4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84dcb712-de3a-419f-9412-c0372430e976", "name": "network-vif-deleted", "tag": "2bf6549d-c2c7-4ff1-8d53-d8423a286a3f"}]} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:48:05.546434 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-2ae9378c-4445-48cf-bccd-a7c6ecb369ea req-c2592b72-b0d8-4e6a-88ca-36f33ce89f4e service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:48:05.546927 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-2ae9378c-4445-48cf-bccd-a7c6ecb369ea req-c2592b72-b0d8-4e6a-88ca-36f33ce89f4e service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:48:05.547366 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-2ae9378c-4445-48cf-bccd-a7c6ecb369ea req-c2592b72-b0d8-4e6a-88ca-36f33ce89f4e service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:48:05.558134 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.compute.server_external_events [req-2ae9378c-4445-48cf-bccd-a7c6ecb369ea req-c2592b72-b0d8-4e6a-88ca-36f33ce89f4e service nova] Creating event network-vif-deleted:2bf6549d-c2c7-4ff1-8d53-d8423a286a3f for instance 84dcb712-de3a-419f-9412-c0372430e976 on hv-cinder-85199 Aug 06 14:48:05.563110 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [req-2ae9378c-4445-48cf-bccd-a7c6ecb369ea req-c2592b72-b0d8-4e6a-88ca-36f33ce89f4e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030627 Aug 06 14:48:05.563720 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 583/1214] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:48:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:48:06.506537 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-6380bb6e-1916-49b3-a1b9-0518b484a624 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:48:06.507122 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-6380bb6e-1916-49b3-a1b9-0518b484a624 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] [instance: 84dcb712-de3a-419f-9412-c0372430e976] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:48:06.513102 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6380bb6e-1916-49b3-a1b9-0518b484a624 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:48:06.513577 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6380bb6e-1916-49b3-a1b9-0518b484a624 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:48:06.514023 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6380bb6e-1916-49b3-a1b9-0518b484a624 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:48:06.520032 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6380bb6e-1916-49b3-a1b9-0518b484a624 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:48:06.520524 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6380bb6e-1916-49b3-a1b9-0518b484a624 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:48:06.520965 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-6380bb6e-1916-49b3-a1b9-0518b484a624 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:48:06.535255 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.wsgi [None req-6380bb6e-1916-49b3-a1b9-0518b484a624 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] HTTP exception thrown: Instance 84dcb712-de3a-419f-9412-c0372430e976 could not be found. Aug 06 14:48:06.536908 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-6380bb6e-1916-49b3-a1b9-0518b484a624 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Request method failure captured: Aug 06 14:48:06.536908 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: request: GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976 HTTP/1.1 Aug 06 14:48:06.536908 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Accept: application/json Aug 06 14:48:06.536908 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Accept-Encoding: identity Aug 06 14:48:06.536908 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Connection: close Aug 06 14:48:06.536908 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Content-Length: 0 Aug 06 14:48:06.536908 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Content-Type: application/json Aug 06 14:48:06.536908 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Host: 10.222.0.17 Aug 06 14:48:06.536908 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Openstack-System-Scope: None Aug 06 14:48:06.536908 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: User-Agent: python-urllib3/1.26.11 Aug 06 14:48:06.536908 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Auth-Token: gAAAAABi7n3b0hWpeBpddxnUQ1mAkMbDl8GvuEqQfla5WiAs-KaamFsDS7mg7ONGEdckRo9PiUO0tAX2L56pHxw-CYSx52NdHdwm7ZRa-eApeU1ozU5iUbd_57aw4OebcWqP4WVEOSflsOTJyId-PR0OwL1KMqeA8xLlJUOOsAG9PvqV2l4Kf20 Aug 06 14:48:06.536908 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Domain-Id: None Aug 06 14:48:06.536908 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Domain-Name: None Aug 06 14:48:06.536908 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Identity-Status: Confirmed Aug 06 14:48:06.536908 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Is-Admin-Project: True Aug 06 14:48:06.536908 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Domain-Id: default Aug 06 14:48:06.536908 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Domain-Name: Default Aug 06 14:48:06.536908 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Id: 779be602b4054e6389c8ade7752e7ac2 Aug 06 14:48:06.536908 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Name: tempest-TestShelveInstance-1121991369 Aug 06 14:48:06.536908 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Role: member,reader Aug 06 14:48:06.536908 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Roles: member,reader Aug 06 14:48:06.538783 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/779be602b4054e6389c8ade7752e7ac2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/779be602b4054e6389c8ade7752e7ac2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_779be602b4054e6389c8ade7752e7ac2", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/779be602b4054e6389c8ade7752e7ac2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 06 14:48:06.538783 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant: tempest-TestShelveInstance-1121991369 Aug 06 14:48:06.538783 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant-Id: 779be602b4054e6389c8ade7752e7ac2 Aug 06 14:48:06.538783 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant-Name: tempest-TestShelveInstance-1121991369 Aug 06 14:48:06.538783 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User: tempest-TestShelveInstance-1121991369-project Aug 06 14:48:06.538783 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Domain-Id: default Aug 06 14:48:06.538783 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Domain-Name: Default Aug 06 14:48:06.538783 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Id: 164c1e7ad0a74e68b4f4cc4bb3eef50e Aug 06 14:48:06.538783 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Name: tempest-TestShelveInstance-1121991369-project Aug 06 14:48:06.538783 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: method: > Aug 06 14:48:06.538783 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: exception: Instance 84dcb712-de3a-419f-9412-c0372430e976 could not be found. Aug 06 14:48:06.538783 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: action_args: {'id': '84dcb712-de3a-419f-9412-c0372430e976'} Aug 06 14:48:06.540060 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 14:48:06.540060 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:48:06.540060 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 14:48:06.540060 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 14:48:06.540060 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 14:48:06.540060 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 14:48:06.540060 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 14:48:06.540060 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 14:48:06.540060 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 14:48:06.540060 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 14:48:06.540060 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84dcb712-de3a-419f-9412-c0372430e976 could not be found. Aug 06 14:48:06.540060 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:48:06.540060 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:48:06.540060 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:48:06.540060 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:48:06.540060 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:48:06.540060 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:48:06.540060 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 14:48:06.540060 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 14:48:06.540060 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 14:48:06.541892 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 14:48:06.541892 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 14:48:06.541892 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 14:48:06.541892 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 14:48:06.541892 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 14:48:06.541892 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 14:48:06.541892 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 14:48:06.541892 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84dcb712-de3a-419f-9412-c0372430e976 could not be found. Aug 06 14:48:06.541892 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:48:06.541892 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:48:06.541892 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:48:06.541892 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:48:06.541892 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:48:06.541892 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:48:06.541892 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 14:48:06.541892 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 14:48:06.541892 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84dcb712-de3a-419f-9412-c0372430e976 could not be found. Aug 06 14:48:06.541892 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:48:06.543468 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-6380bb6e-1916-49b3-a1b9-0518b484a624 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Returning 404 to user: Instance 84dcb712-de3a-419f-9412-c0372430e976 could not be found. {{(pid=117837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 14:48:06.543468 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-6380bb6e-1916-49b3-a1b9-0518b484a624 tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] 10.222.0.17 "GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976" status: 404 len: 111 microversion: 2.1 time: 0.036162 Aug 06 14:48:06.543468 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 632/1215] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:48:06 2022] GET /compute/v2.1/servers/84dcb712-de3a-419f-9412-c0372430e976 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 14:48:06.704048 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-17b46a3e-f08b-4793-9627-b7409a1141bd tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] Calling method '.version_select at 0x7fbab153dc10>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:48:06.709761 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR oslo.messaging._drivers.impl_rabbit [None req-17b46a3e-f08b-4793-9627-b7409a1141bd tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] [2e3c81be-0ba2-4cdc-8cb2-6d23799bf190] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 06 14:48:07.717060 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO oslo.messaging._drivers.impl_rabbit [None req-17b46a3e-f08b-4793-9627-b7409a1141bd tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] [2e3c81be-0ba2-4cdc-8cb2-6d23799bf190] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 52220. Aug 06 14:48:07.735274 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-17b46a3e-f08b-4793-9627-b7409a1141bd tempest-TestShelveInstance-1121991369 tempest-TestShelveInstance-1121991369-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-581051277" status: 202 len: 0 microversion: 2.1 time: 1.035759 Aug 06 14:48:07.735839 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 584/1216] 10.222.0.17 () {58 vars in 1251 bytes} [Sat Aug 6 14:48:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-581051277 => generated 0 bytes in 1037 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 14:48:23.184496 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 14:48:23.185116 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Sat Aug 6 14:48:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 14:48:37.922484 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 14:48:37.923349 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Sat Aug 6 14:48:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 14:48:57.518679 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-b2bdc470-2139-46f3-b830-6b0952ba6fe0 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1326767345", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-603286594", "security_groups": [{"name": "tempest-secgroup-smoke-1234795654"}], "block_device_mapping_v2": [{"uuid": "62c6c46e-c5ad-4292-aca1-0f27e48a545e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "75577732-bec1-435e-9165-942aae4827a6"}]}} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:48:57.529088 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_api:SELECT=8 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:48:57.529719 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_cell1:SELECT=16 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:48:57.630715 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.network.neutron [None req-b2bdc470-2139-46f3-b830-6b0952ba6fe0 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] validate_networks() for [('75577732-bec1-435e-9165-942aae4827a6', None, None, None, None, None)] {{(pid=117837) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 06 14:48:58.105234 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.virt.hardware [None req-b2bdc470-2139-46f3-b830-6b0952ba6fe0 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Flavor limits 0:0:0 {{(pid=117837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 06 14:48:58.105675 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.virt.hardware [None req-b2bdc470-2139-46f3-b830-6b0952ba6fe0 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Image limits 0:0:0 {{(pid=117837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 06 14:48:58.106141 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.virt.hardware [None req-b2bdc470-2139-46f3-b830-6b0952ba6fe0 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Flavor pref 0:0:0 {{(pid=117837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 06 14:48:58.106544 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.virt.hardware [None req-b2bdc470-2139-46f3-b830-6b0952ba6fe0 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Image pref 0:0:0 {{(pid=117837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 06 14:48:58.106981 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.virt.hardware [None req-b2bdc470-2139-46f3-b830-6b0952ba6fe0 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117837) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 06 14:48:58.115510 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b2bdc470-2139-46f3-b830-6b0952ba6fe0 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:48:58.115980 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b2bdc470-2139-46f3-b830-6b0952ba6fe0 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:48:58.116409 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b2bdc470-2139-46f3-b830-6b0952ba6fe0 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:48:58.117120 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b2bdc470-2139-46f3-b830-6b0952ba6fe0 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:48:58.117566 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b2bdc470-2139-46f3-b830-6b0952ba6fe0 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:48:58.117987 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-b2bdc470-2139-46f3-b830-6b0952ba6fe0 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:48:58.134719 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.quota [None req-b2bdc470-2139-46f3-b830-6b0952ba6fe0 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Getting quotas for project f344fdd32c8d482c8df161211d12fcd6. Resources: {'cores', 'instances', 'ram'} {{(pid=117837) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 06 14:48:58.138607 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.quota [None req-b2bdc470-2139-46f3-b830-6b0952ba6fe0 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Getting quotas for user 0500bcc4b18e4e2cab39fb3d867cce70 and project f344fdd32c8d482c8df161211d12fcd6. Resources: {'cores', 'instances', 'ram'} {{(pid=117837) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 06 14:48:58.194614 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-b2bdc470-2139-46f3-b830-6b0952ba6fe0 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Going to run 1 instances... {{(pid=117837) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 06 14:48:58.196689 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-b2bdc470-2139-46f3-b830-6b0952ba6fe0 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] [instance: 97e58721-0d77-47b7-b374-0600f7a600b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='62c6c46e-c5ad-4292-aca1-0f27e48a545e',volume_size=None,volume_type=None)] {{(pid=117837) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 06 14:48:58.321956 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-b2bdc470-2139-46f3-b830-6b0952ba6fe0 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.807640 Aug 06 14:48:58.322583 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 633/1217] 10.222.0.17 () {60 vars in 1147 bytes} [Sat Aug 6 14:48:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 809 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 06 14:48:58.330893 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:48:58.332086 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:48:58.336549 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-25d1f0d9-1d72-4445-94c9-e7ad8e0bcda1 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:48:58.337854 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-25d1f0d9-1d72-4445-94c9-e7ad8e0bcda1 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] [instance: 97e58721-0d77-47b7-b374-0600f7a600b9] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:48:58.400216 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-25d1f0d9-1d72-4445-94c9-e7ad8e0bcda1 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0500bcc4b18e4e2cab39fb3d867cce70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f344fdd32c8d482c8df161211d12fcd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:48:58.407107 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-25d1f0d9-1d72-4445-94c9-e7ad8e0bcda1 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] 10.222.0.17 "GET /compute/v2.1/servers/97e58721-0d77-47b7-b374-0600f7a600b9" status: 200 len: 1094 microversion: 2.1 time: 0.077627 Aug 06 14:48:58.407605 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 585/1218] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:48:58 2022] GET /compute/v2.1/servers/97e58721-0d77-47b7-b374-0600f7a600b9 => generated 1094 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:48:59.428483 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-18add1e6-379b-43f8-9e54-00ccf0178893 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:48:59.429096 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-18add1e6-379b-43f8-9e54-00ccf0178893 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] [instance: 97e58721-0d77-47b7-b374-0600f7a600b9] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:48:59.435616 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-18add1e6-379b-43f8-9e54-00ccf0178893 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:48:59.436133 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-18add1e6-379b-43f8-9e54-00ccf0178893 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:48:59.436572 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-18add1e6-379b-43f8-9e54-00ccf0178893 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:48:59.437268 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-18add1e6-379b-43f8-9e54-00ccf0178893 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:48:59.437981 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-18add1e6-379b-43f8-9e54-00ccf0178893 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:48:59.438407 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-18add1e6-379b-43f8-9e54-00ccf0178893 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:48:59.521359 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-18add1e6-379b-43f8-9e54-00ccf0178893 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0500bcc4b18e4e2cab39fb3d867cce70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f344fdd32c8d482c8df161211d12fcd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:48:59.529006 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-18add1e6-379b-43f8-9e54-00ccf0178893 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] 10.222.0.17 "GET /compute/v2.1/servers/97e58721-0d77-47b7-b374-0600f7a600b9" status: 200 len: 1200 microversion: 2.1 time: 0.105007 Aug 06 14:48:59.529569 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 634/1219] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:48:59 2022] GET /compute/v2.1/servers/97e58721-0d77-47b7-b374-0600f7a600b9 => generated 1200 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:49:00.549759 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-0160bc38-78a9-4905-9d74-ca8f45c04b04 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:49:00.550440 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-0160bc38-78a9-4905-9d74-ca8f45c04b04 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] [instance: 97e58721-0d77-47b7-b374-0600f7a600b9] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:49:00.558027 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0160bc38-78a9-4905-9d74-ca8f45c04b04 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:49:00.558748 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0160bc38-78a9-4905-9d74-ca8f45c04b04 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:49:00.559402 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0160bc38-78a9-4905-9d74-ca8f45c04b04 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:49:00.560315 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0160bc38-78a9-4905-9d74-ca8f45c04b04 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:49:00.560765 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0160bc38-78a9-4905-9d74-ca8f45c04b04 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:49:00.561187 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0160bc38-78a9-4905-9d74-ca8f45c04b04 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:49:00.701845 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-0160bc38-78a9-4905-9d74-ca8f45c04b04 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0500bcc4b18e4e2cab39fb3d867cce70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f344fdd32c8d482c8df161211d12fcd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:49:00.710633 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-0160bc38-78a9-4905-9d74-ca8f45c04b04 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] 10.222.0.17 "GET /compute/v2.1/servers/97e58721-0d77-47b7-b374-0600f7a600b9" status: 200 len: 1266 microversion: 2.1 time: 0.164679 Aug 06 14:49:00.711796 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 586/1220] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:49:00 2022] GET /compute/v2.1/servers/97e58721-0d77-47b7-b374-0600f7a600b9 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:49:01.104757 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [req-2c943e08-b657-4dc6-ad10-736512eab12d req-9442be3c-4d41-4c3e-b6d0-730c8386e5c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97e58721-0d77-47b7-b374-0600f7a600b9", "tag": "9c89bb45-b5b9-4201-b2a1-03e91a247e00"}]} {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:49:01.115379 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-2c943e08-b657-4dc6-ad10-736512eab12d req-9442be3c-4d41-4c3e-b6d0-730c8386e5c0 service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:49:01.115850 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-2c943e08-b657-4dc6-ad10-736512eab12d req-9442be3c-4d41-4c3e-b6d0-730c8386e5c0 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:49:01.116646 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [req-2c943e08-b657-4dc6-ad10-736512eab12d req-9442be3c-4d41-4c3e-b6d0-730c8386e5c0 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:49:01.128972 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.compute.server_external_events [req-2c943e08-b657-4dc6-ad10-736512eab12d req-9442be3c-4d41-4c3e-b6d0-730c8386e5c0 service nova] Creating event network-changed:9c89bb45-b5b9-4201-b2a1-03e91a247e00 for instance 97e58721-0d77-47b7-b374-0600f7a600b9 on hv-cinder-85199 Aug 06 14:49:01.133994 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [req-2c943e08-b657-4dc6-ad10-736512eab12d req-9442be3c-4d41-4c3e-b6d0-730c8386e5c0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032984 Aug 06 14:49:01.134577 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 635/1221] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:49:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:49:01.733609 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-c2b889e9-3750-4239-8972-6ab2ce977dcc tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:49:01.734217 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-c2b889e9-3750-4239-8972-6ab2ce977dcc tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] [instance: 97e58721-0d77-47b7-b374-0600f7a600b9] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:49:01.740922 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c2b889e9-3750-4239-8972-6ab2ce977dcc tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:49:01.741399 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c2b889e9-3750-4239-8972-6ab2ce977dcc tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:49:01.741835 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c2b889e9-3750-4239-8972-6ab2ce977dcc tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:49:01.742617 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c2b889e9-3750-4239-8972-6ab2ce977dcc tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:49:01.743099 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c2b889e9-3750-4239-8972-6ab2ce977dcc tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:49:01.743521 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c2b889e9-3750-4239-8972-6ab2ce977dcc tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:49:01.870377 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-c2b889e9-3750-4239-8972-6ab2ce977dcc tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0500bcc4b18e4e2cab39fb3d867cce70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f344fdd32c8d482c8df161211d12fcd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:49:01.877931 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-c2b889e9-3750-4239-8972-6ab2ce977dcc tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] 10.222.0.17 "GET /compute/v2.1/servers/97e58721-0d77-47b7-b374-0600f7a600b9" status: 200 len: 1266 microversion: 2.1 time: 0.148298 Aug 06 14:49:01.878493 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 587/1222] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:49:01 2022] GET /compute/v2.1/servers/97e58721-0d77-47b7-b374-0600f7a600b9 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:49:02.898947 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-4a8d7c5e-b8a3-48c9-930e-e3ad0742715e tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:49:02.899651 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-4a8d7c5e-b8a3-48c9-930e-e3ad0742715e tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] [instance: 97e58721-0d77-47b7-b374-0600f7a600b9] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:49:02.905795 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-4a8d7c5e-b8a3-48c9-930e-e3ad0742715e tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:49:02.906254 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-4a8d7c5e-b8a3-48c9-930e-e3ad0742715e tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:49:02.906686 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-4a8d7c5e-b8a3-48c9-930e-e3ad0742715e tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:49:02.907394 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-4a8d7c5e-b8a3-48c9-930e-e3ad0742715e tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:49:02.907844 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-4a8d7c5e-b8a3-48c9-930e-e3ad0742715e tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:49:02.908265 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-4a8d7c5e-b8a3-48c9-930e-e3ad0742715e tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:49:03.086645 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-4a8d7c5e-b8a3-48c9-930e-e3ad0742715e tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0500bcc4b18e4e2cab39fb3d867cce70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f344fdd32c8d482c8df161211d12fcd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:49:03.094408 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-4a8d7c5e-b8a3-48c9-930e-e3ad0742715e tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] 10.222.0.17 "GET /compute/v2.1/servers/97e58721-0d77-47b7-b374-0600f7a600b9" status: 200 len: 1266 microversion: 2.1 time: 0.200221 Aug 06 14:49:03.095054 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 636/1223] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:49:02 2022] GET /compute/v2.1/servers/97e58721-0d77-47b7-b374-0600f7a600b9 => generated 1266 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:49:04.114290 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-c68a4853-ae51-46b6-a927-86829cae9f34 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:49:04.114827 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-c68a4853-ae51-46b6-a927-86829cae9f34 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] [instance: 97e58721-0d77-47b7-b374-0600f7a600b9] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:49:04.121194 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c68a4853-ae51-46b6-a927-86829cae9f34 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:49:04.121672 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c68a4853-ae51-46b6-a927-86829cae9f34 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:49:04.122099 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c68a4853-ae51-46b6-a927-86829cae9f34 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:49:04.122812 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c68a4853-ae51-46b6-a927-86829cae9f34 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:49:04.123282 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c68a4853-ae51-46b6-a927-86829cae9f34 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:49:04.123705 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-c68a4853-ae51-46b6-a927-86829cae9f34 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:49:04.255662 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-c68a4853-ae51-46b6-a927-86829cae9f34 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0500bcc4b18e4e2cab39fb3d867cce70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f344fdd32c8d482c8df161211d12fcd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:49:04.262998 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-c68a4853-ae51-46b6-a927-86829cae9f34 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] 10.222.0.17 "GET /compute/v2.1/servers/97e58721-0d77-47b7-b374-0600f7a600b9" status: 200 len: 1266 microversion: 2.1 time: 0.152713 Aug 06 14:49:04.263592 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 588/1224] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:49:04 2022] GET /compute/v2.1/servers/97e58721-0d77-47b7-b374-0600f7a600b9 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:49:05.284679 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-a166ab45-b246-4ce2-99ba-60888d46b50b tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:49:05.285378 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-a166ab45-b246-4ce2-99ba-60888d46b50b tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] [instance: 97e58721-0d77-47b7-b374-0600f7a600b9] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:49:05.291635 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a166ab45-b246-4ce2-99ba-60888d46b50b tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:49:05.292105 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a166ab45-b246-4ce2-99ba-60888d46b50b tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:49:05.292528 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a166ab45-b246-4ce2-99ba-60888d46b50b tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:49:05.293203 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a166ab45-b246-4ce2-99ba-60888d46b50b tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:49:05.293658 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a166ab45-b246-4ce2-99ba-60888d46b50b tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:49:05.294064 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a166ab45-b246-4ce2-99ba-60888d46b50b tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:49:05.425168 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-a166ab45-b246-4ce2-99ba-60888d46b50b tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0500bcc4b18e4e2cab39fb3d867cce70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f344fdd32c8d482c8df161211d12fcd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:49:05.432637 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-a166ab45-b246-4ce2-99ba-60888d46b50b tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] 10.222.0.17 "GET /compute/v2.1/servers/97e58721-0d77-47b7-b374-0600f7a600b9" status: 200 len: 1266 microversion: 2.1 time: 0.152365 Aug 06 14:49:05.433195 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 637/1225] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:49:05 2022] GET /compute/v2.1/servers/97e58721-0d77-47b7-b374-0600f7a600b9 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:49:06.453607 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-3ad7f469-8108-4f52-bb20-27ee2e9c6256 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:49:06.454218 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-3ad7f469-8108-4f52-bb20-27ee2e9c6256 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] [instance: 97e58721-0d77-47b7-b374-0600f7a600b9] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:49:06.460835 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3ad7f469-8108-4f52-bb20-27ee2e9c6256 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:49:06.461254 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3ad7f469-8108-4f52-bb20-27ee2e9c6256 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:49:06.461686 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3ad7f469-8108-4f52-bb20-27ee2e9c6256 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:49:06.462367 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3ad7f469-8108-4f52-bb20-27ee2e9c6256 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:49:06.462820 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3ad7f469-8108-4f52-bb20-27ee2e9c6256 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:49:06.463271 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-3ad7f469-8108-4f52-bb20-27ee2e9c6256 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:49:06.591993 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-3ad7f469-8108-4f52-bb20-27ee2e9c6256 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0500bcc4b18e4e2cab39fb3d867cce70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f344fdd32c8d482c8df161211d12fcd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:49:06.600138 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-3ad7f469-8108-4f52-bb20-27ee2e9c6256 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] 10.222.0.17 "GET /compute/v2.1/servers/97e58721-0d77-47b7-b374-0600f7a600b9" status: 200 len: 1266 microversion: 2.1 time: 0.150417 Aug 06 14:49:06.600706 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 589/1226] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:49:06 2022] GET /compute/v2.1/servers/97e58721-0d77-47b7-b374-0600f7a600b9 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:49:07.620521 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-299a33af-dbd7-476d-98a5-c5facca9d8eb tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:49:07.621219 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-299a33af-dbd7-476d-98a5-c5facca9d8eb tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] [instance: 97e58721-0d77-47b7-b374-0600f7a600b9] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:49:07.628234 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-299a33af-dbd7-476d-98a5-c5facca9d8eb tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:49:07.628713 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-299a33af-dbd7-476d-98a5-c5facca9d8eb tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:49:07.629145 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-299a33af-dbd7-476d-98a5-c5facca9d8eb tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:49:07.629834 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-299a33af-dbd7-476d-98a5-c5facca9d8eb tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:49:07.630284 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-299a33af-dbd7-476d-98a5-c5facca9d8eb tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:49:07.630707 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-299a33af-dbd7-476d-98a5-c5facca9d8eb tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:49:07.759590 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-299a33af-dbd7-476d-98a5-c5facca9d8eb tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0500bcc4b18e4e2cab39fb3d867cce70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f344fdd32c8d482c8df161211d12fcd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:49:07.767047 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-299a33af-dbd7-476d-98a5-c5facca9d8eb tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] 10.222.0.17 "GET /compute/v2.1/servers/97e58721-0d77-47b7-b374-0600f7a600b9" status: 200 len: 1266 microversion: 2.1 time: 0.150376 Aug 06 14:49:07.767593 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 638/1227] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:49:07 2022] GET /compute/v2.1/servers/97e58721-0d77-47b7-b374-0600f7a600b9 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:49:08.788000 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-b7166ca7-3182-4f37-99ee-cfca5a7e2ba9 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:49:08.788612 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-b7166ca7-3182-4f37-99ee-cfca5a7e2ba9 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] [instance: 97e58721-0d77-47b7-b374-0600f7a600b9] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:49:08.790979 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_cell0:SELECT=2 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:49:08.796513 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b7166ca7-3182-4f37-99ee-cfca5a7e2ba9 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:49:08.796990 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b7166ca7-3182-4f37-99ee-cfca5a7e2ba9 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:49:08.797421 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b7166ca7-3182-4f37-99ee-cfca5a7e2ba9 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:49:08.798109 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b7166ca7-3182-4f37-99ee-cfca5a7e2ba9 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:49:08.799087 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b7166ca7-3182-4f37-99ee-cfca5a7e2ba9 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:49:08.799509 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-b7166ca7-3182-4f37-99ee-cfca5a7e2ba9 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:49:08.936071 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-b7166ca7-3182-4f37-99ee-cfca5a7e2ba9 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0500bcc4b18e4e2cab39fb3d867cce70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f344fdd32c8d482c8df161211d12fcd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:49:08.944496 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-b7166ca7-3182-4f37-99ee-cfca5a7e2ba9 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] 10.222.0.17 "GET /compute/v2.1/servers/97e58721-0d77-47b7-b374-0600f7a600b9" status: 200 len: 1266 microversion: 2.1 time: 0.160705 Aug 06 14:49:08.945063 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 590/1228] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:49:08 2022] GET /compute/v2.1/servers/97e58721-0d77-47b7-b374-0600f7a600b9 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:49:09.964802 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-1d9d7e82-ec08-4d9c-801f-f57784ab4e1d tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:49:09.965415 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-1d9d7e82-ec08-4d9c-801f-f57784ab4e1d tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] [instance: 97e58721-0d77-47b7-b374-0600f7a600b9] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:49:09.967363 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_cell0:SELECT=2 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:49:09.968025 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_cell0:SELECT=6 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:49:09.974483 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1d9d7e82-ec08-4d9c-801f-f57784ab4e1d tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:49:09.974993 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1d9d7e82-ec08-4d9c-801f-f57784ab4e1d tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:49:09.975429 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1d9d7e82-ec08-4d9c-801f-f57784ab4e1d tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:49:09.976115 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1d9d7e82-ec08-4d9c-801f-f57784ab4e1d tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:49:09.976566 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1d9d7e82-ec08-4d9c-801f-f57784ab4e1d tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:49:09.976986 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-1d9d7e82-ec08-4d9c-801f-f57784ab4e1d tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:49:10.104206 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-1d9d7e82-ec08-4d9c-801f-f57784ab4e1d tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0500bcc4b18e4e2cab39fb3d867cce70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f344fdd32c8d482c8df161211d12fcd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:49:10.111605 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-1d9d7e82-ec08-4d9c-801f-f57784ab4e1d tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] 10.222.0.17 "GET /compute/v2.1/servers/97e58721-0d77-47b7-b374-0600f7a600b9" status: 200 len: 1266 microversion: 2.1 time: 0.150684 Aug 06 14:49:10.112159 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 639/1229] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:49:09 2022] GET /compute/v2.1/servers/97e58721-0d77-47b7-b374-0600f7a600b9 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:49:11.131388 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-fafc5969-0eec-4fc6-976b-9568286bb561 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:49:11.131991 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-fafc5969-0eec-4fc6-976b-9568286bb561 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] [instance: 97e58721-0d77-47b7-b374-0600f7a600b9] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:49:11.138374 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-fafc5969-0eec-4fc6-976b-9568286bb561 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:49:11.138849 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-fafc5969-0eec-4fc6-976b-9568286bb561 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:49:11.139307 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-fafc5969-0eec-4fc6-976b-9568286bb561 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:49:11.139994 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-fafc5969-0eec-4fc6-976b-9568286bb561 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:49:11.140446 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-fafc5969-0eec-4fc6-976b-9568286bb561 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:49:11.140868 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-fafc5969-0eec-4fc6-976b-9568286bb561 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:49:11.270257 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-fafc5969-0eec-4fc6-976b-9568286bb561 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0500bcc4b18e4e2cab39fb3d867cce70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f344fdd32c8d482c8df161211d12fcd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:49:11.277754 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-fafc5969-0eec-4fc6-976b-9568286bb561 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] 10.222.0.17 "GET /compute/v2.1/servers/97e58721-0d77-47b7-b374-0600f7a600b9" status: 200 len: 1266 microversion: 2.1 time: 0.150185 Aug 06 14:49:11.278522 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 591/1230] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:49:11 2022] GET /compute/v2.1/servers/97e58721-0d77-47b7-b374-0600f7a600b9 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:49:12.297478 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-2afd1448-abd5-4216-86b6-50ff3e73927c tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:49:12.298063 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-2afd1448-abd5-4216-86b6-50ff3e73927c tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] [instance: 97e58721-0d77-47b7-b374-0600f7a600b9] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:49:12.305006 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2afd1448-abd5-4216-86b6-50ff3e73927c tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:49:12.305482 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2afd1448-abd5-4216-86b6-50ff3e73927c tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:49:12.305911 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2afd1448-abd5-4216-86b6-50ff3e73927c tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:49:12.306593 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2afd1448-abd5-4216-86b6-50ff3e73927c tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:49:12.307096 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2afd1448-abd5-4216-86b6-50ff3e73927c tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:49:12.307517 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-2afd1448-abd5-4216-86b6-50ff3e73927c tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:49:12.535693 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-2afd1448-abd5-4216-86b6-50ff3e73927c tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0500bcc4b18e4e2cab39fb3d867cce70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f344fdd32c8d482c8df161211d12fcd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:49:12.543065 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-2afd1448-abd5-4216-86b6-50ff3e73927c tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] 10.222.0.17 "GET /compute/v2.1/servers/97e58721-0d77-47b7-b374-0600f7a600b9" status: 200 len: 1266 microversion: 2.1 time: 0.249411 Aug 06 14:49:12.543629 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 640/1231] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:49:12 2022] GET /compute/v2.1/servers/97e58721-0d77-47b7-b374-0600f7a600b9 => generated 1266 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:49:12.898640 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [req-74b5549e-1597-48d6-a1b0-3ad821f4398c req-96254b9e-b9e4-4627-ac3f-32fe76cdf2a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97e58721-0d77-47b7-b374-0600f7a600b9", "name": "network-vif-plugged", "status": "completed", "tag": "9c89bb45-b5b9-4201-b2a1-03e91a247e00"}]} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:49:12.907786 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-74b5549e-1597-48d6-a1b0-3ad821f4398c req-96254b9e-b9e4-4627-ac3f-32fe76cdf2a3 service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:49:12.908252 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-74b5549e-1597-48d6-a1b0-3ad821f4398c req-96254b9e-b9e4-4627-ac3f-32fe76cdf2a3 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:49:12.908675 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-74b5549e-1597-48d6-a1b0-3ad821f4398c req-96254b9e-b9e4-4627-ac3f-32fe76cdf2a3 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:49:12.919202 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.compute.server_external_events [req-74b5549e-1597-48d6-a1b0-3ad821f4398c req-96254b9e-b9e4-4627-ac3f-32fe76cdf2a3 service nova] Creating event network-vif-plugged:9c89bb45-b5b9-4201-b2a1-03e91a247e00 for instance 97e58721-0d77-47b7-b374-0600f7a600b9 on hv-cinder-85199 Aug 06 14:49:12.924075 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [req-74b5549e-1597-48d6-a1b0-3ad821f4398c req-96254b9e-b9e4-4627-ac3f-32fe76cdf2a3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.183397 Aug 06 14:49:12.924584 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 592/1232] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:49:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:49:13.563724 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-68613b8e-735b-41c8-9e38-02619f0b95bf tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:49:13.564869 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-68613b8e-735b-41c8-9e38-02619f0b95bf tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] [instance: 97e58721-0d77-47b7-b374-0600f7a600b9] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:49:13.571379 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-68613b8e-735b-41c8-9e38-02619f0b95bf tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:49:13.571861 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-68613b8e-735b-41c8-9e38-02619f0b95bf tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:49:13.572295 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-68613b8e-735b-41c8-9e38-02619f0b95bf tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:49:13.572990 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-68613b8e-735b-41c8-9e38-02619f0b95bf tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:49:13.573467 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-68613b8e-735b-41c8-9e38-02619f0b95bf tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:49:13.573889 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-68613b8e-735b-41c8-9e38-02619f0b95bf tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:49:13.705487 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-68613b8e-735b-41c8-9e38-02619f0b95bf tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0500bcc4b18e4e2cab39fb3d867cce70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f344fdd32c8d482c8df161211d12fcd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:49:13.713034 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-68613b8e-735b-41c8-9e38-02619f0b95bf tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] 10.222.0.17 "GET /compute/v2.1/servers/97e58721-0d77-47b7-b374-0600f7a600b9" status: 200 len: 1266 microversion: 2.1 time: 0.153512 Aug 06 14:49:13.713600 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 641/1233] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:49:13 2022] GET /compute/v2.1/servers/97e58721-0d77-47b7-b374-0600f7a600b9 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:49:14.734546 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-05c05923-531b-451c-a4b2-293274877465 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:49:14.735183 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-05c05923-531b-451c-a4b2-293274877465 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] [instance: 97e58721-0d77-47b7-b374-0600f7a600b9] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:49:14.741345 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-05c05923-531b-451c-a4b2-293274877465 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:49:14.741818 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-05c05923-531b-451c-a4b2-293274877465 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:49:14.742248 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-05c05923-531b-451c-a4b2-293274877465 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:49:14.742962 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-05c05923-531b-451c-a4b2-293274877465 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:49:14.743412 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-05c05923-531b-451c-a4b2-293274877465 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:49:14.743829 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-05c05923-531b-451c-a4b2-293274877465 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:49:14.876337 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-05c05923-531b-451c-a4b2-293274877465 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0500bcc4b18e4e2cab39fb3d867cce70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f344fdd32c8d482c8df161211d12fcd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:49:14.884489 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-05c05923-531b-451c-a4b2-293274877465 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] 10.222.0.17 "GET /compute/v2.1/servers/97e58721-0d77-47b7-b374-0600f7a600b9" status: 200 len: 1454 microversion: 2.1 time: 0.154691 Aug 06 14:49:14.885047 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 593/1234] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:49:14 2022] GET /compute/v2.1/servers/97e58721-0d77-47b7-b374-0600f7a600b9 => generated 1454 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:49:14.903690 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-0520664c-0010-45dc-9ab7-428cd5fe6c79 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:49:14.904298 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-0520664c-0010-45dc-9ab7-428cd5fe6c79 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] [instance: 97e58721-0d77-47b7-b374-0600f7a600b9] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:49:14.910602 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0520664c-0010-45dc-9ab7-428cd5fe6c79 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:49:14.911118 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0520664c-0010-45dc-9ab7-428cd5fe6c79 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:49:14.911550 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0520664c-0010-45dc-9ab7-428cd5fe6c79 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:49:14.912230 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0520664c-0010-45dc-9ab7-428cd5fe6c79 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:49:14.912689 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0520664c-0010-45dc-9ab7-428cd5fe6c79 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:49:14.913108 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-0520664c-0010-45dc-9ab7-428cd5fe6c79 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:49:15.041333 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-0520664c-0010-45dc-9ab7-428cd5fe6c79 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0500bcc4b18e4e2cab39fb3d867cce70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f344fdd32c8d482c8df161211d12fcd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:49:15.049326 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-0520664c-0010-45dc-9ab7-428cd5fe6c79 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] 10.222.0.17 "GET /compute/v2.1/servers/97e58721-0d77-47b7-b374-0600f7a600b9" status: 200 len: 1454 microversion: 2.1 time: 0.149395 Aug 06 14:49:15.049890 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 642/1235] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:49:14 2022] GET /compute/v2.1/servers/97e58721-0d77-47b7-b374-0600f7a600b9 => generated 1454 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:49:16.702240 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [req-e9674107-3715-4fed-a3df-601192cd0b9c req-54c561e8-f699-406a-b3e7-fa18e854974b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97e58721-0d77-47b7-b374-0600f7a600b9", "tag": "9c89bb45-b5b9-4201-b2a1-03e91a247e00"}]} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:49:16.711800 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-e9674107-3715-4fed-a3df-601192cd0b9c req-54c561e8-f699-406a-b3e7-fa18e854974b service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:49:16.712264 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-e9674107-3715-4fed-a3df-601192cd0b9c req-54c561e8-f699-406a-b3e7-fa18e854974b service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:49:16.712688 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-e9674107-3715-4fed-a3df-601192cd0b9c req-54c561e8-f699-406a-b3e7-fa18e854974b service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:49:16.723769 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.compute.server_external_events [req-e9674107-3715-4fed-a3df-601192cd0b9c req-54c561e8-f699-406a-b3e7-fa18e854974b service nova] Creating event network-changed:9c89bb45-b5b9-4201-b2a1-03e91a247e00 for instance 97e58721-0d77-47b7-b374-0600f7a600b9 on hv-cinder-85199 Aug 06 14:49:16.728713 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [req-e9674107-3715-4fed-a3df-601192cd0b9c req-54c561e8-f699-406a-b3e7-fa18e854974b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030205 Aug 06 14:49:16.729305 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 594/1236] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:49:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:51:06.240139 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:51:06.240937 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG dbcounter [-] [117837] Writing DB stats nova_cell1:SELECT=52 {{(pid=117837) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:51:06.244909 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_api:SELECT=22 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:51:06.245381 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-434bb6f6-9cdc-45d3-9743-ac01d2a1561f tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:51:06.245648 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-434bb6f6-9cdc-45d3-9743-ac01d2a1561f tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] [instance: 97e58721-0d77-47b7-b374-0600f7a600b9] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:51:06.246545 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG dbcounter [-] [117838] Writing DB stats nova_cell1:SELECT=46 {{(pid=117838) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 06 14:51:06.253616 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-434bb6f6-9cdc-45d3-9743-ac01d2a1561f tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:51:06.254102 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-434bb6f6-9cdc-45d3-9743-ac01d2a1561f tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:51:06.254410 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [req-5bf3a27c-c7c8-485a-b5d0-7d9f9b66be1c req-4a215947-0e41-40bb-84a2-e0ce0cc257a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97e58721-0d77-47b7-b374-0600f7a600b9", "tag": "9c89bb45-b5b9-4201-b2a1-03e91a247e00"}]} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:51:06.254578 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-434bb6f6-9cdc-45d3-9743-ac01d2a1561f tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:51:06.255248 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-434bb6f6-9cdc-45d3-9743-ac01d2a1561f tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:51:06.255698 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-434bb6f6-9cdc-45d3-9743-ac01d2a1561f tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:51:06.256372 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-434bb6f6-9cdc-45d3-9743-ac01d2a1561f tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:51:06.265056 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-5bf3a27c-c7c8-485a-b5d0-7d9f9b66be1c req-4a215947-0e41-40bb-84a2-e0ce0cc257a9 service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:51:06.265650 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-5bf3a27c-c7c8-485a-b5d0-7d9f9b66be1c req-4a215947-0e41-40bb-84a2-e0ce0cc257a9 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:51:06.266337 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-5bf3a27c-c7c8-485a-b5d0-7d9f9b66be1c req-4a215947-0e41-40bb-84a2-e0ce0cc257a9 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:51:06.280755 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.compute.server_external_events [req-5bf3a27c-c7c8-485a-b5d0-7d9f9b66be1c req-4a215947-0e41-40bb-84a2-e0ce0cc257a9 service nova] Creating event network-changed:9c89bb45-b5b9-4201-b2a1-03e91a247e00 for instance 97e58721-0d77-47b7-b374-0600f7a600b9 on hv-cinder-85199 Aug 06 14:51:06.282772 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-434bb6f6-9cdc-45d3-9743-ac01d2a1561f tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] [instance: 97e58721-0d77-47b7-b374-0600f7a600b9] Going to try to terminate instance {{(pid=117837) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 14:51:06.287319 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [req-5bf3a27c-c7c8-485a-b5d0-7d9f9b66be1c req-4a215947-0e41-40bb-84a2-e0ce0cc257a9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044809 Aug 06 14:51:06.288132 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 595/1237] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:51:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 14:51:06.373251 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-434bb6f6-9cdc-45d3-9743-ac01d2a1561f tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] 10.222.0.17 "DELETE /compute/v2.1/servers/97e58721-0d77-47b7-b374-0600f7a600b9" status: 204 len: 0 microversion: 2.1 time: 0.135291 Aug 06 14:51:06.374161 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 643/1238] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Aug 6 14:51:06 2022] DELETE /compute/v2.1/servers/97e58721-0d77-47b7-b374-0600f7a600b9 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 14:51:06.383554 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-62609303-30ac-4b59-98dd-f71ca9de3c0e tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:51:06.384267 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-62609303-30ac-4b59-98dd-f71ca9de3c0e tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] [instance: 97e58721-0d77-47b7-b374-0600f7a600b9] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:51:06.392300 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-62609303-30ac-4b59-98dd-f71ca9de3c0e tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:51:06.392798 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-62609303-30ac-4b59-98dd-f71ca9de3c0e tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:51:06.393235 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-62609303-30ac-4b59-98dd-f71ca9de3c0e tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:51:06.394047 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-62609303-30ac-4b59-98dd-f71ca9de3c0e tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:51:06.394501 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-62609303-30ac-4b59-98dd-f71ca9de3c0e tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:51:06.394958 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-62609303-30ac-4b59-98dd-f71ca9de3c0e tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:51:06.587400 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-62609303-30ac-4b59-98dd-f71ca9de3c0e tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0500bcc4b18e4e2cab39fb3d867cce70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f344fdd32c8d482c8df161211d12fcd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:51:06.595430 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-62609303-30ac-4b59-98dd-f71ca9de3c0e tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] 10.222.0.17 "GET /compute/v2.1/servers/97e58721-0d77-47b7-b374-0600f7a600b9" status: 200 len: 1578 microversion: 2.1 time: 0.216158 Aug 06 14:51:06.596162 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 596/1239] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:51:06 2022] GET /compute/v2.1/servers/97e58721-0d77-47b7-b374-0600f7a600b9 => generated 1578 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:51:07.616236 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-24dbe03d-d031-4866-a3ba-4cd4e4f8e7fe tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:51:07.617038 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-24dbe03d-d031-4866-a3ba-4cd4e4f8e7fe tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] [instance: 97e58721-0d77-47b7-b374-0600f7a600b9] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:51:07.623729 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-24dbe03d-d031-4866-a3ba-4cd4e4f8e7fe tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:51:07.624203 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-24dbe03d-d031-4866-a3ba-4cd4e4f8e7fe tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:51:07.624640 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-24dbe03d-d031-4866-a3ba-4cd4e4f8e7fe tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:51:07.625332 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-24dbe03d-d031-4866-a3ba-4cd4e4f8e7fe tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:51:07.625780 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-24dbe03d-d031-4866-a3ba-4cd4e4f8e7fe tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:51:07.626197 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-24dbe03d-d031-4866-a3ba-4cd4e4f8e7fe tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:51:07.809076 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-24dbe03d-d031-4866-a3ba-4cd4e4f8e7fe tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0500bcc4b18e4e2cab39fb3d867cce70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f344fdd32c8d482c8df161211d12fcd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:51:07.817399 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-24dbe03d-d031-4866-a3ba-4cd4e4f8e7fe tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] 10.222.0.17 "GET /compute/v2.1/servers/97e58721-0d77-47b7-b374-0600f7a600b9" status: 200 len: 1578 microversion: 2.1 time: 0.205392 Aug 06 14:51:07.817963 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 644/1240] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:51:07 2022] GET /compute/v2.1/servers/97e58721-0d77-47b7-b374-0600f7a600b9 => generated 1578 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:51:08.730958 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [req-e13dc634-9f17-49db-a7e3-7e116e81c02a req-d2294ce2-1d62-4f0c-bc8f-833dcde1c43d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97e58721-0d77-47b7-b374-0600f7a600b9", "name": "network-vif-deleted", "tag": "9c89bb45-b5b9-4201-b2a1-03e91a247e00"}]} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:51:08.740065 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-e13dc634-9f17-49db-a7e3-7e116e81c02a req-d2294ce2-1d62-4f0c-bc8f-833dcde1c43d service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:51:08.740529 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-e13dc634-9f17-49db-a7e3-7e116e81c02a req-d2294ce2-1d62-4f0c-bc8f-833dcde1c43d service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:51:08.740952 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-e13dc634-9f17-49db-a7e3-7e116e81c02a req-d2294ce2-1d62-4f0c-bc8f-833dcde1c43d service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:51:08.753036 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.compute.server_external_events [req-e13dc634-9f17-49db-a7e3-7e116e81c02a req-d2294ce2-1d62-4f0c-bc8f-833dcde1c43d service nova] Creating event network-vif-deleted:9c89bb45-b5b9-4201-b2a1-03e91a247e00 for instance 97e58721-0d77-47b7-b374-0600f7a600b9 on hv-cinder-85199 Aug 06 14:51:08.757818 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [req-e13dc634-9f17-49db-a7e3-7e116e81c02a req-d2294ce2-1d62-4f0c-bc8f-833dcde1c43d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088335 Aug 06 14:51:08.758380 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 597/1241] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:51:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:51:08.838063 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-d1783643-c43d-460c-ba85-841ca2e3b2bc tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:51:08.838698 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-d1783643-c43d-460c-ba85-841ca2e3b2bc tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] [instance: 97e58721-0d77-47b7-b374-0600f7a600b9] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:51:08.845318 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d1783643-c43d-460c-ba85-841ca2e3b2bc tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:51:08.845800 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d1783643-c43d-460c-ba85-841ca2e3b2bc tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:51:08.846236 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d1783643-c43d-460c-ba85-841ca2e3b2bc tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:51:08.847558 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d1783643-c43d-460c-ba85-841ca2e3b2bc tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:51:08.848322 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d1783643-c43d-460c-ba85-841ca2e3b2bc tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:51:08.848445 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-d1783643-c43d-460c-ba85-841ca2e3b2bc tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:51:08.913045 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-d1783643-c43d-460c-ba85-841ca2e3b2bc tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0500bcc4b18e4e2cab39fb3d867cce70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f344fdd32c8d482c8df161211d12fcd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:51:08.920560 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-d1783643-c43d-460c-ba85-841ca2e3b2bc tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] 10.222.0.17 "GET /compute/v2.1/servers/97e58721-0d77-47b7-b374-0600f7a600b9" status: 200 len: 1225 microversion: 2.1 time: 0.086580 Aug 06 14:51:08.921121 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 645/1242] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:51:08 2022] GET /compute/v2.1/servers/97e58721-0d77-47b7-b374-0600f7a600b9 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:51:09.942526 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-54c45f6d-b591-4d5d-ae16-0735ef0ebf87 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:51:09.943235 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-54c45f6d-b591-4d5d-ae16-0735ef0ebf87 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] [instance: 97e58721-0d77-47b7-b374-0600f7a600b9] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:51:09.949640 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-54c45f6d-b591-4d5d-ae16-0735ef0ebf87 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:51:09.950116 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-54c45f6d-b591-4d5d-ae16-0735ef0ebf87 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:51:09.950547 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-54c45f6d-b591-4d5d-ae16-0735ef0ebf87 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:51:09.951254 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-54c45f6d-b591-4d5d-ae16-0735ef0ebf87 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:51:09.951702 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-54c45f6d-b591-4d5d-ae16-0735ef0ebf87 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:51:09.952122 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-54c45f6d-b591-4d5d-ae16-0735ef0ebf87 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:51:09.965809 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.wsgi [None req-54c45f6d-b591-4d5d-ae16-0735ef0ebf87 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] HTTP exception thrown: Instance 97e58721-0d77-47b7-b374-0600f7a600b9 could not be found. Aug 06 14:51:09.967425 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-54c45f6d-b591-4d5d-ae16-0735ef0ebf87 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Request method failure captured: Aug 06 14:51:09.967425 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: request: GET /compute/v2.1/servers/97e58721-0d77-47b7-b374-0600f7a600b9 HTTP/1.1 Aug 06 14:51:09.967425 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Accept: application/json Aug 06 14:51:09.967425 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Accept-Encoding: identity Aug 06 14:51:09.967425 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Connection: close Aug 06 14:51:09.967425 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Content-Length: 0 Aug 06 14:51:09.967425 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Content-Type: application/json Aug 06 14:51:09.967425 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Host: 10.222.0.17 Aug 06 14:51:09.967425 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Openstack-System-Scope: None Aug 06 14:51:09.967425 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: User-Agent: python-urllib3/1.26.11 Aug 06 14:51:09.967425 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Auth-Token: gAAAAABi7n38WKmQYcvLHWr8GzZ9dMEpVf8eK3oj3NaBuFcy3UU1iwmUOZ72YxufI1B1CvqtE8i-rBoW78fNzACCLFXwfEy-YrDIBlKWE09lHwqY0hz3Ij_0uAM_igWrO1N2NEI9Pb9zn1EwnzIwoR6NeQfg_tOCe9GVK72MxuG6ZqLh1-Zympo Aug 06 14:51:09.967425 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Domain-Id: None Aug 06 14:51:09.967425 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Domain-Name: None Aug 06 14:51:09.967425 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Identity-Status: Confirmed Aug 06 14:51:09.967425 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Is-Admin-Project: True Aug 06 14:51:09.967425 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Domain-Id: default Aug 06 14:51:09.967425 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Domain-Name: Default Aug 06 14:51:09.967425 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Id: f344fdd32c8d482c8df161211d12fcd6 Aug 06 14:51:09.967425 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Name: tempest-TestVolumeBootPattern-1969510220 Aug 06 14:51:09.967425 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Role: member,reader Aug 06 14:51:09.967425 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Roles: member,reader Aug 06 14:51:09.969223 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f344fdd32c8d482c8df161211d12fcd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f344fdd32c8d482c8df161211d12fcd6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f344fdd32c8d482c8df161211d12fcd6", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f344fdd32c8d482c8df161211d12fcd6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 06 14:51:09.969223 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Tenant: tempest-TestVolumeBootPattern-1969510220 Aug 06 14:51:09.969223 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Tenant-Id: f344fdd32c8d482c8df161211d12fcd6 Aug 06 14:51:09.969223 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Tenant-Name: tempest-TestVolumeBootPattern-1969510220 Aug 06 14:51:09.969223 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User: tempest-TestVolumeBootPattern-1969510220-project Aug 06 14:51:09.969223 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Domain-Id: default Aug 06 14:51:09.969223 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Domain-Name: Default Aug 06 14:51:09.969223 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Id: 0500bcc4b18e4e2cab39fb3d867cce70 Aug 06 14:51:09.969223 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Name: tempest-TestVolumeBootPattern-1969510220-project Aug 06 14:51:09.969223 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: method: > Aug 06 14:51:09.969223 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: exception: Instance 97e58721-0d77-47b7-b374-0600f7a600b9 could not be found. Aug 06 14:51:09.969223 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: action_args: {'id': '97e58721-0d77-47b7-b374-0600f7a600b9'} Aug 06 14:51:09.970248 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 14:51:09.970248 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:51:09.970248 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 14:51:09.970248 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 14:51:09.970248 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 14:51:09.970248 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 14:51:09.970248 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 14:51:09.970248 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 14:51:09.970248 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 14:51:09.970248 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 14:51:09.970248 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97e58721-0d77-47b7-b374-0600f7a600b9 could not be found. Aug 06 14:51:09.970248 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:51:09.970248 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:51:09.970248 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:51:09.970248 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:51:09.970248 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:51:09.970248 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:51:09.970248 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 14:51:09.970248 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 14:51:09.970248 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 14:51:09.972360 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 14:51:09.972360 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 14:51:09.972360 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 14:51:09.972360 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 14:51:09.972360 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 14:51:09.972360 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 14:51:09.972360 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 14:51:09.972360 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97e58721-0d77-47b7-b374-0600f7a600b9 could not be found. Aug 06 14:51:09.972360 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:51:09.972360 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:51:09.972360 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:51:09.972360 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:51:09.972360 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:51:09.972360 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:51:09.972360 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 14:51:09.972360 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 14:51:09.972360 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97e58721-0d77-47b7-b374-0600f7a600b9 could not be found. Aug 06 14:51:09.972360 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:51:09.973864 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-54c45f6d-b591-4d5d-ae16-0735ef0ebf87 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Returning 404 to user: Instance 97e58721-0d77-47b7-b374-0600f7a600b9 could not be found. {{(pid=117838) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 14:51:09.973864 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-54c45f6d-b591-4d5d-ae16-0735ef0ebf87 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] 10.222.0.17 "GET /compute/v2.1/servers/97e58721-0d77-47b7-b374-0600f7a600b9" status: 404 len: 111 microversion: 2.1 time: 0.031244 Aug 06 14:51:09.973864 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 598/1243] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:51:09 2022] GET /compute/v2.1/servers/97e58721-0d77-47b7-b374-0600f7a600b9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 14:51:13.025901 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [req-923304c9-8736-4751-b793-ddb7686f6f88 req-de94c062-b1c6-447e-999b-3087e486f233 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8a79e24-ca9d-4be2-8988-4daac9ecb9d7", "tag": "6a832a1f-ed35-4400-a6d9-8bc4d3860594"}]} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:51:13.028981 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-a9eb7eab-eced-4e75-b955-8f0aa5bffc7f tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:51:13.029483 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-a9eb7eab-eced-4e75-b955-8f0aa5bffc7f tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] [instance: d8a79e24-ca9d-4be2-8988-4daac9ecb9d7] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:51:13.041871 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a9eb7eab-eced-4e75-b955-8f0aa5bffc7f tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:51:13.042390 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a9eb7eab-eced-4e75-b955-8f0aa5bffc7f tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:51:13.042534 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-923304c9-8736-4751-b793-ddb7686f6f88 req-de94c062-b1c6-447e-999b-3087e486f233 service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:51:13.042808 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a9eb7eab-eced-4e75-b955-8f0aa5bffc7f tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:51:13.043039 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-923304c9-8736-4751-b793-ddb7686f6f88 req-de94c062-b1c6-447e-999b-3087e486f233 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:51:13.043353 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-923304c9-8736-4751-b793-ddb7686f6f88 req-de94c062-b1c6-447e-999b-3087e486f233 service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:51:13.043533 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a9eb7eab-eced-4e75-b955-8f0aa5bffc7f tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:51:13.044165 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a9eb7eab-eced-4e75-b955-8f0aa5bffc7f tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:51:13.044781 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-a9eb7eab-eced-4e75-b955-8f0aa5bffc7f tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:51:13.056549 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.compute.server_external_events [req-923304c9-8736-4751-b793-ddb7686f6f88 req-de94c062-b1c6-447e-999b-3087e486f233 service nova] Creating event network-changed:6a832a1f-ed35-4400-a6d9-8bc4d3860594 for instance d8a79e24-ca9d-4be2-8988-4daac9ecb9d7 on hv-cinder-85199 Aug 06 14:51:13.062287 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [req-923304c9-8736-4751-b793-ddb7686f6f88 req-de94c062-b1c6-447e-999b-3087e486f233 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039944 Aug 06 14:51:13.062890 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 599/1244] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:51:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 06 14:51:13.071379 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-a9eb7eab-eced-4e75-b955-8f0aa5bffc7f tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] [instance: d8a79e24-ca9d-4be2-8988-4daac9ecb9d7] Going to try to terminate instance {{(pid=117837) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 06 14:51:13.161522 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-a9eb7eab-eced-4e75-b955-8f0aa5bffc7f tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d8a79e24-ca9d-4be2-8988-4daac9ecb9d7" status: 204 len: 0 microversion: 2.1 time: 0.141979 Aug 06 14:51:13.162304 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 646/1245] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Aug 6 14:51:13 2022] DELETE /compute/v2.1/servers/d8a79e24-ca9d-4be2-8988-4daac9ecb9d7 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 06 14:51:13.170982 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-cd6b84a6-2208-414d-a24c-74a73648c78e tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:51:13.171730 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-cd6b84a6-2208-414d-a24c-74a73648c78e tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] [instance: d8a79e24-ca9d-4be2-8988-4daac9ecb9d7] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:51:13.178463 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-cd6b84a6-2208-414d-a24c-74a73648c78e tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:51:13.178983 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-cd6b84a6-2208-414d-a24c-74a73648c78e tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:51:13.179414 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-cd6b84a6-2208-414d-a24c-74a73648c78e tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:51:13.180105 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-cd6b84a6-2208-414d-a24c-74a73648c78e tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:51:13.180614 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-cd6b84a6-2208-414d-a24c-74a73648c78e tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:51:13.180976 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-cd6b84a6-2208-414d-a24c-74a73648c78e tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:51:13.312343 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.policy [None req-cd6b84a6-2208-414d-a24c-74a73648c78e tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0500bcc4b18e4e2cab39fb3d867cce70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f344fdd32c8d482c8df161211d12fcd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117838) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:51:13.320182 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-cd6b84a6-2208-414d-a24c-74a73648c78e tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] 10.222.0.17 "GET /compute/v2.1/servers/d8a79e24-ca9d-4be2-8988-4daac9ecb9d7" status: 200 len: 1577 microversion: 2.1 time: 0.153451 Aug 06 14:51:13.320749 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 600/1246] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:51:13 2022] GET /compute/v2.1/servers/d8a79e24-ca9d-4be2-8988-4daac9ecb9d7 => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:51:14.341911 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-cc48a82f-5097-4401-a39b-3dd44e1fca7d tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:51:14.342607 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-cc48a82f-5097-4401-a39b-3dd44e1fca7d tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] [instance: d8a79e24-ca9d-4be2-8988-4daac9ecb9d7] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:51:14.349341 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-cc48a82f-5097-4401-a39b-3dd44e1fca7d tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:51:14.349816 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-cc48a82f-5097-4401-a39b-3dd44e1fca7d tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:51:14.350246 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-cc48a82f-5097-4401-a39b-3dd44e1fca7d tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:51:14.350958 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-cc48a82f-5097-4401-a39b-3dd44e1fca7d tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:51:14.351407 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-cc48a82f-5097-4401-a39b-3dd44e1fca7d tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:51:14.351827 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-cc48a82f-5097-4401-a39b-3dd44e1fca7d tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:51:14.482178 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-cc48a82f-5097-4401-a39b-3dd44e1fca7d tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0500bcc4b18e4e2cab39fb3d867cce70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f344fdd32c8d482c8df161211d12fcd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:51:14.490337 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-cc48a82f-5097-4401-a39b-3dd44e1fca7d tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] 10.222.0.17 "GET /compute/v2.1/servers/d8a79e24-ca9d-4be2-8988-4daac9ecb9d7" status: 200 len: 1577 microversion: 2.1 time: 0.152602 Aug 06 14:51:14.490910 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 647/1247] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:51:14 2022] GET /compute/v2.1/servers/d8a79e24-ca9d-4be2-8988-4daac9ecb9d7 => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:51:15.429069 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [req-249d947e-b9f8-4139-90f5-038cb0dc618a req-3c155de3-1e5a-4ec9-a018-9ec3020843fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8a79e24-ca9d-4be2-8988-4daac9ecb9d7", "name": "network-vif-deleted", "tag": "6a832a1f-ed35-4400-a6d9-8bc4d3860594"}]} {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 06 14:51:15.441098 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-249d947e-b9f8-4139-90f5-038cb0dc618a req-3c155de3-1e5a-4ec9-a018-9ec3020843fc service nova] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:51:15.442364 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-249d947e-b9f8-4139-90f5-038cb0dc618a req-3c155de3-1e5a-4ec9-a018-9ec3020843fc service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:51:15.443147 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [req-249d947e-b9f8-4139-90f5-038cb0dc618a req-3c155de3-1e5a-4ec9-a018-9ec3020843fc service nova] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:51:15.455255 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.compute.server_external_events [req-249d947e-b9f8-4139-90f5-038cb0dc618a req-3c155de3-1e5a-4ec9-a018-9ec3020843fc service nova] Creating event network-vif-deleted:6a832a1f-ed35-4400-a6d9-8bc4d3860594 for instance d8a79e24-ca9d-4be2-8988-4daac9ecb9d7 on hv-cinder-85199 Aug 06 14:51:15.461907 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [req-249d947e-b9f8-4139-90f5-038cb0dc618a req-3c155de3-1e5a-4ec9-a018-9ec3020843fc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037648 Aug 06 14:51:15.462540 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 601/1248] 10.222.0.17 () {64 vars in 1317 bytes} [Sat Aug 6 14:51:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 06 14:51:15.510253 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-95e9ccbc-5cec-4159-90f4-580512adb6d8 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:51:15.510888 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-95e9ccbc-5cec-4159-90f4-580512adb6d8 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] [instance: d8a79e24-ca9d-4be2-8988-4daac9ecb9d7] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:51:15.517212 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-95e9ccbc-5cec-4159-90f4-580512adb6d8 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:51:15.517696 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-95e9ccbc-5cec-4159-90f4-580512adb6d8 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:51:15.518625 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-95e9ccbc-5cec-4159-90f4-580512adb6d8 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:51:15.519535 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-95e9ccbc-5cec-4159-90f4-580512adb6d8 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:51:15.519985 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-95e9ccbc-5cec-4159-90f4-580512adb6d8 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:51:15.520409 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-95e9ccbc-5cec-4159-90f4-580512adb6d8 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:51:15.584398 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.policy [None req-95e9ccbc-5cec-4159-90f4-580512adb6d8 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0500bcc4b18e4e2cab39fb3d867cce70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f344fdd32c8d482c8df161211d12fcd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117837) authorize /opt/stack/nova/nova/policy.py:199}} Aug 06 14:51:15.591986 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-95e9ccbc-5cec-4159-90f4-580512adb6d8 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] 10.222.0.17 "GET /compute/v2.1/servers/d8a79e24-ca9d-4be2-8988-4daac9ecb9d7" status: 200 len: 1224 microversion: 2.1 time: 0.085692 Aug 06 14:51:15.592540 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 648/1249] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:51:15 2022] GET /compute/v2.1/servers/d8a79e24-ca9d-4be2-8988-4daac9ecb9d7 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 06 14:51:16.614146 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-0a3619f8-8dc5-4b4c-a490-71347e4c3201 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:51:16.614840 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-0a3619f8-8dc5-4b4c-a490-71347e4c3201 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] [instance: d8a79e24-ca9d-4be2-8988-4daac9ecb9d7] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:51:16.621464 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0a3619f8-8dc5-4b4c-a490-71347e4c3201 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:51:16.621937 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0a3619f8-8dc5-4b4c-a490-71347e4c3201 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:51:16.622365 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0a3619f8-8dc5-4b4c-a490-71347e4c3201 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:51:16.623088 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0a3619f8-8dc5-4b4c-a490-71347e4c3201 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:51:16.623535 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0a3619f8-8dc5-4b4c-a490-71347e4c3201 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:51:16.623951 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-0a3619f8-8dc5-4b4c-a490-71347e4c3201 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:51:16.636753 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.wsgi [None req-0a3619f8-8dc5-4b4c-a490-71347e4c3201 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] HTTP exception thrown: Instance d8a79e24-ca9d-4be2-8988-4daac9ecb9d7 could not be found. Aug 06 14:51:16.638321 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-0a3619f8-8dc5-4b4c-a490-71347e4c3201 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Request method failure captured: Aug 06 14:51:16.638321 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: request: GET /compute/v2.1/servers/d8a79e24-ca9d-4be2-8988-4daac9ecb9d7 HTTP/1.1 Aug 06 14:51:16.638321 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Accept: application/json Aug 06 14:51:16.638321 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Accept-Encoding: identity Aug 06 14:51:16.638321 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Connection: close Aug 06 14:51:16.638321 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Content-Length: 0 Aug 06 14:51:16.638321 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Content-Type: application/json Aug 06 14:51:16.638321 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Host: 10.222.0.17 Aug 06 14:51:16.638321 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Openstack-System-Scope: None Aug 06 14:51:16.638321 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: User-Agent: python-urllib3/1.26.11 Aug 06 14:51:16.638321 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Auth-Token: gAAAAABi7n38WKmQYcvLHWr8GzZ9dMEpVf8eK3oj3NaBuFcy3UU1iwmUOZ72YxufI1B1CvqtE8i-rBoW78fNzACCLFXwfEy-YrDIBlKWE09lHwqY0hz3Ij_0uAM_igWrO1N2NEI9Pb9zn1EwnzIwoR6NeQfg_tOCe9GVK72MxuG6ZqLh1-Zympo Aug 06 14:51:16.638321 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Domain-Id: None Aug 06 14:51:16.638321 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Domain-Name: None Aug 06 14:51:16.638321 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Identity-Status: Confirmed Aug 06 14:51:16.638321 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Is-Admin-Project: True Aug 06 14:51:16.638321 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Domain-Id: default Aug 06 14:51:16.638321 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Domain-Name: Default Aug 06 14:51:16.638321 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Id: f344fdd32c8d482c8df161211d12fcd6 Aug 06 14:51:16.638321 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Name: tempest-TestVolumeBootPattern-1969510220 Aug 06 14:51:16.638321 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Role: member,reader Aug 06 14:51:16.638321 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Roles: member,reader Aug 06 14:51:16.640209 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f344fdd32c8d482c8df161211d12fcd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f344fdd32c8d482c8df161211d12fcd6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f344fdd32c8d482c8df161211d12fcd6", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f344fdd32c8d482c8df161211d12fcd6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 06 14:51:16.640209 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Tenant: tempest-TestVolumeBootPattern-1969510220 Aug 06 14:51:16.640209 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Tenant-Id: f344fdd32c8d482c8df161211d12fcd6 Aug 06 14:51:16.640209 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Tenant-Name: tempest-TestVolumeBootPattern-1969510220 Aug 06 14:51:16.640209 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User: tempest-TestVolumeBootPattern-1969510220-project Aug 06 14:51:16.640209 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Domain-Id: default Aug 06 14:51:16.640209 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Domain-Name: Default Aug 06 14:51:16.640209 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Id: 0500bcc4b18e4e2cab39fb3d867cce70 Aug 06 14:51:16.640209 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Name: tempest-TestVolumeBootPattern-1969510220-project Aug 06 14:51:16.640209 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: method: > Aug 06 14:51:16.640209 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: exception: Instance d8a79e24-ca9d-4be2-8988-4daac9ecb9d7 could not be found. Aug 06 14:51:16.640209 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: action_args: {'id': 'd8a79e24-ca9d-4be2-8988-4daac9ecb9d7'} Aug 06 14:51:16.641169 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 14:51:16.641169 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:51:16.641169 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 14:51:16.641169 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 14:51:16.641169 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 14:51:16.641169 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 14:51:16.641169 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 14:51:16.641169 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 14:51:16.641169 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 14:51:16.641169 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 14:51:16.641169 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8a79e24-ca9d-4be2-8988-4daac9ecb9d7 could not be found. Aug 06 14:51:16.641169 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:51:16.641169 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:51:16.641169 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:51:16.641169 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:51:16.641169 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:51:16.641169 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:51:16.641169 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 14:51:16.641169 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 14:51:16.641169 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 14:51:16.642622 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 14:51:16.642622 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 14:51:16.642622 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 14:51:16.642622 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 14:51:16.642622 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 14:51:16.642622 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 14:51:16.642622 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 14:51:16.642622 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8a79e24-ca9d-4be2-8988-4daac9ecb9d7 could not be found. Aug 06 14:51:16.642622 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:51:16.642622 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:51:16.642622 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:51:16.642622 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:51:16.642622 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:51:16.642622 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:51:16.642622 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 14:51:16.642622 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 14:51:16.642622 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8a79e24-ca9d-4be2-8988-4daac9ecb9d7 could not be found. Aug 06 14:51:16.642622 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:51:16.644006 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-0a3619f8-8dc5-4b4c-a490-71347e4c3201 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Returning 404 to user: Instance d8a79e24-ca9d-4be2-8988-4daac9ecb9d7 could not be found. {{(pid=117838) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 14:51:16.644006 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-0a3619f8-8dc5-4b4c-a490-71347e4c3201 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] 10.222.0.17 "GET /compute/v2.1/servers/d8a79e24-ca9d-4be2-8988-4daac9ecb9d7" status: 404 len: 111 microversion: 2.1 time: 0.030401 Aug 06 14:51:16.644006 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 602/1250] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:51:16 2022] GET /compute/v2.1/servers/d8a79e24-ca9d-4be2-8988-4daac9ecb9d7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 14:51:17.072034 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-910583f1-48fa-43df-a104-85fa650d4aa0 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Calling method '>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:51:17.072513 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.compute.api [None req-910583f1-48fa-43df-a104-85fa650d4aa0 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] [instance: 20d7f033-8d80-4f4c-89d4-76d92081a555] Fetching instance by UUID {{(pid=117837) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:51:17.079043 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-910583f1-48fa-43df-a104-85fa650d4aa0 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:51:17.079510 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-910583f1-48fa-43df-a104-85fa650d4aa0 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:51:17.079939 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-910583f1-48fa-43df-a104-85fa650d4aa0 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:51:17.081124 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-910583f1-48fa-43df-a104-85fa650d4aa0 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:51:17.081576 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-910583f1-48fa-43df-a104-85fa650d4aa0 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:51:17.081993 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG oslo_concurrency.lockutils [None req-910583f1-48fa-43df-a104-85fa650d4aa0 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117837) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:51:17.095111 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.wsgi [None req-910583f1-48fa-43df-a104-85fa650d4aa0 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] HTTP exception thrown: Instance 20d7f033-8d80-4f4c-89d4-76d92081a555 could not be found. Aug 06 14:51:17.097347 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-910583f1-48fa-43df-a104-85fa650d4aa0 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Request method failure captured: Aug 06 14:51:17.097347 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: request: DELETE /compute/v2.1/servers/20d7f033-8d80-4f4c-89d4-76d92081a555 HTTP/1.1 Aug 06 14:51:17.097347 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Accept: application/json Aug 06 14:51:17.097347 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Accept-Encoding: identity Aug 06 14:51:17.097347 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Connection: close Aug 06 14:51:17.097347 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Content-Length: 0 Aug 06 14:51:17.097347 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Content-Type: application/json Aug 06 14:51:17.097347 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Host: 10.222.0.17 Aug 06 14:51:17.097347 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Openstack-System-Scope: None Aug 06 14:51:17.097347 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: User-Agent: python-urllib3/1.26.11 Aug 06 14:51:17.097347 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Auth-Token: gAAAAABi7n38WKmQYcvLHWr8GzZ9dMEpVf8eK3oj3NaBuFcy3UU1iwmUOZ72YxufI1B1CvqtE8i-rBoW78fNzACCLFXwfEy-YrDIBlKWE09lHwqY0hz3Ij_0uAM_igWrO1N2NEI9Pb9zn1EwnzIwoR6NeQfg_tOCe9GVK72MxuG6ZqLh1-Zympo Aug 06 14:51:17.097347 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Domain-Id: None Aug 06 14:51:17.097347 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Domain-Name: None Aug 06 14:51:17.097347 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Identity-Status: Confirmed Aug 06 14:51:17.097347 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Is-Admin-Project: True Aug 06 14:51:17.097347 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Domain-Id: default Aug 06 14:51:17.097347 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Domain-Name: Default Aug 06 14:51:17.097347 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Id: f344fdd32c8d482c8df161211d12fcd6 Aug 06 14:51:17.097347 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Project-Name: tempest-TestVolumeBootPattern-1969510220 Aug 06 14:51:17.097347 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Role: member,reader Aug 06 14:51:17.097347 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Roles: member,reader Aug 06 14:51:17.099138 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f344fdd32c8d482c8df161211d12fcd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f344fdd32c8d482c8df161211d12fcd6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f344fdd32c8d482c8df161211d12fcd6", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f344fdd32c8d482c8df161211d12fcd6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 06 14:51:17.099138 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant: tempest-TestVolumeBootPattern-1969510220 Aug 06 14:51:17.099138 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant-Id: f344fdd32c8d482c8df161211d12fcd6 Aug 06 14:51:17.099138 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-Tenant-Name: tempest-TestVolumeBootPattern-1969510220 Aug 06 14:51:17.099138 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User: tempest-TestVolumeBootPattern-1969510220-project Aug 06 14:51:17.099138 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Domain-Id: default Aug 06 14:51:17.099138 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Domain-Name: Default Aug 06 14:51:17.099138 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Id: 0500bcc4b18e4e2cab39fb3d867cce70 Aug 06 14:51:17.099138 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: X-User-Name: tempest-TestVolumeBootPattern-1969510220-project Aug 06 14:51:17.099138 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: method: > Aug 06 14:51:17.099138 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: exception: Instance 20d7f033-8d80-4f4c-89d4-76d92081a555 could not be found. Aug 06 14:51:17.099138 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: action_args: {'id': '20d7f033-8d80-4f4c-89d4-76d92081a555'} Aug 06 14:51:17.100248 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 14:51:17.100248 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:51:17.100248 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 14:51:17.100248 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 14:51:17.100248 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 14:51:17.100248 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 14:51:17.100248 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 14:51:17.100248 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 14:51:17.100248 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 14:51:17.100248 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 14:51:17.100248 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20d7f033-8d80-4f4c-89d4-76d92081a555 could not be found. Aug 06 14:51:17.100248 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:51:17.100248 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:51:17.100248 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:51:17.100248 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:51:17.100248 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:51:17.100248 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:51:17.100248 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 14:51:17.100248 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 14:51:17.100248 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 14:51:17.101881 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 14:51:17.101881 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 06 14:51:17.101881 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 06 14:51:17.101881 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 06 14:51:17.101881 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 06 14:51:17.101881 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 14:51:17.101881 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 14:51:17.101881 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 14:51:17.101881 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 14:51:17.101881 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20d7f033-8d80-4f4c-89d4-76d92081a555 could not be found. Aug 06 14:51:17.101881 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:51:17.101881 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:51:17.101881 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:51:17.101881 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:51:17.101881 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:51:17.101881 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:51:17.101881 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 14:51:17.101881 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 14:51:17.101881 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20d7f033-8d80-4f4c-89d4-76d92081a555 could not be found. Aug 06 14:51:17.101881 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: ERROR nova.api.openstack.wsgi Aug 06 14:51:17.103810 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-910583f1-48fa-43df-a104-85fa650d4aa0 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Returning 404 to user: Instance 20d7f033-8d80-4f4c-89d4-76d92081a555 could not be found. {{(pid=117837) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 14:51:17.103810 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-910583f1-48fa-43df-a104-85fa650d4aa0 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] 10.222.0.17 "DELETE /compute/v2.1/servers/20d7f033-8d80-4f4c-89d4-76d92081a555" status: 404 len: 111 microversion: 2.1 time: 0.030512 Aug 06 14:51:17.103810 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 649/1251] 10.222.0.17 () {58 vars in 1239 bytes} [Sat Aug 6 14:51:17 2022] DELETE /compute/v2.1/servers/20d7f033-8d80-4f4c-89d4-76d92081a555 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 14:51:17.107229 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-d27b22ae-e02c-4498-91d7-b2517e5f2869 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Calling method '>' {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:51:17.107842 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.compute.api [None req-d27b22ae-e02c-4498-91d7-b2517e5f2869 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] [instance: 20d7f033-8d80-4f4c-89d4-76d92081a555] Fetching instance by UUID {{(pid=117838) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 06 14:51:17.113771 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d27b22ae-e02c-4498-91d7-b2517e5f2869 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:51:17.114246 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d27b22ae-e02c-4498-91d7-b2517e5f2869 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:51:17.114677 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d27b22ae-e02c-4498-91d7-b2517e5f2869 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:51:17.115388 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d27b22ae-e02c-4498-91d7-b2517e5f2869 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Acquiring lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 06 14:51:17.115839 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d27b22ae-e02c-4498-91d7-b2517e5f2869 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 06 14:51:17.116260 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG oslo_concurrency.lockutils [None req-d27b22ae-e02c-4498-91d7-b2517e5f2869 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Lock "fd953adc-bbd7-49ea-a6a5-a2e44aba103c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117838) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 06 14:51:17.131577 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.wsgi [None req-d27b22ae-e02c-4498-91d7-b2517e5f2869 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] HTTP exception thrown: Instance 20d7f033-8d80-4f4c-89d4-76d92081a555 could not be found. Aug 06 14:51:17.133061 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-d27b22ae-e02c-4498-91d7-b2517e5f2869 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Request method failure captured: Aug 06 14:51:17.133061 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: request: GET /compute/v2.1/servers/20d7f033-8d80-4f4c-89d4-76d92081a555 HTTP/1.1 Aug 06 14:51:17.133061 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Accept: application/json Aug 06 14:51:17.133061 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Accept-Encoding: identity Aug 06 14:51:17.133061 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Connection: close Aug 06 14:51:17.133061 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Content-Length: 0 Aug 06 14:51:17.133061 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Content-Type: application/json Aug 06 14:51:17.133061 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Host: 10.222.0.17 Aug 06 14:51:17.133061 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Openstack-System-Scope: None Aug 06 14:51:17.133061 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: User-Agent: python-urllib3/1.26.11 Aug 06 14:51:17.133061 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Auth-Token: gAAAAABi7n38WKmQYcvLHWr8GzZ9dMEpVf8eK3oj3NaBuFcy3UU1iwmUOZ72YxufI1B1CvqtE8i-rBoW78fNzACCLFXwfEy-YrDIBlKWE09lHwqY0hz3Ij_0uAM_igWrO1N2NEI9Pb9zn1EwnzIwoR6NeQfg_tOCe9GVK72MxuG6ZqLh1-Zympo Aug 06 14:51:17.133061 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Domain-Id: None Aug 06 14:51:17.133061 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Domain-Name: None Aug 06 14:51:17.133061 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Identity-Status: Confirmed Aug 06 14:51:17.133061 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Is-Admin-Project: True Aug 06 14:51:17.133061 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Domain-Id: default Aug 06 14:51:17.133061 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Domain-Name: Default Aug 06 14:51:17.133061 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Id: f344fdd32c8d482c8df161211d12fcd6 Aug 06 14:51:17.133061 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Project-Name: tempest-TestVolumeBootPattern-1969510220 Aug 06 14:51:17.133061 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Role: member,reader Aug 06 14:51:17.133061 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Roles: member,reader Aug 06 14:51:17.134841 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f344fdd32c8d482c8df161211d12fcd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f344fdd32c8d482c8df161211d12fcd6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f344fdd32c8d482c8df161211d12fcd6", "adminURL": "http://10.222.0.17:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f344fdd32c8d482c8df161211d12fcd6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}] Aug 06 14:51:17.134841 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Tenant: tempest-TestVolumeBootPattern-1969510220 Aug 06 14:51:17.134841 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Tenant-Id: f344fdd32c8d482c8df161211d12fcd6 Aug 06 14:51:17.134841 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-Tenant-Name: tempest-TestVolumeBootPattern-1969510220 Aug 06 14:51:17.134841 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User: tempest-TestVolumeBootPattern-1969510220-project Aug 06 14:51:17.134841 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Domain-Id: default Aug 06 14:51:17.134841 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Domain-Name: Default Aug 06 14:51:17.134841 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Id: 0500bcc4b18e4e2cab39fb3d867cce70 Aug 06 14:51:17.134841 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: X-User-Name: tempest-TestVolumeBootPattern-1969510220-project Aug 06 14:51:17.134841 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: method: > Aug 06 14:51:17.134841 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: exception: Instance 20d7f033-8d80-4f4c-89d4-76d92081a555 could not be found. Aug 06 14:51:17.134841 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: action_args: {'id': '20d7f033-8d80-4f4c-89d4-76d92081a555'} Aug 06 14:51:17.135957 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: {{(pid=117838) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 06 14:51:17.135957 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:51:17.135957 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 06 14:51:17.135957 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 06 14:51:17.135957 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 06 14:51:17.135957 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 06 14:51:17.135957 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 06 14:51:17.135957 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 06 14:51:17.135957 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 06 14:51:17.135957 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 06 14:51:17.135957 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20d7f033-8d80-4f4c-89d4-76d92081a555 could not be found. Aug 06 14:51:17.135957 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:51:17.135957 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:51:17.135957 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:51:17.135957 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:51:17.135957 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:51:17.135957 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:51:17.135957 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 06 14:51:17.135957 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 06 14:51:17.135957 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 06 14:51:17.138025 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 06 14:51:17.138025 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 06 14:51:17.138025 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 06 14:51:17.138025 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 06 14:51:17.138025 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 06 14:51:17.138025 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 06 14:51:17.138025 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 06 14:51:17.138025 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20d7f033-8d80-4f4c-89d4-76d92081a555 could not be found. Aug 06 14:51:17.138025 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:51:17.138025 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 06 14:51:17.138025 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:51:17.138025 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 06 14:51:17.138025 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 06 14:51:17.138025 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 06 14:51:17.138025 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 06 14:51:17.138025 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 06 14:51:17.138025 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20d7f033-8d80-4f4c-89d4-76d92081a555 could not be found. Aug 06 14:51:17.138025 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: ERROR nova.api.openstack.wsgi Aug 06 14:51:17.139549 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: DEBUG nova.api.openstack.wsgi [None req-d27b22ae-e02c-4498-91d7-b2517e5f2869 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Returning 404 to user: Instance 20d7f033-8d80-4f4c-89d4-76d92081a555 could not be found. {{(pid=117838) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 06 14:51:17.139549 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO nova.api.openstack.requestlog [None req-d27b22ae-e02c-4498-91d7-b2517e5f2869 tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] 10.222.0.17 "GET /compute/v2.1/servers/20d7f033-8d80-4f4c-89d4-76d92081a555" status: 404 len: 111 microversion: 2.1 time: 0.031012 Aug 06 14:51:17.139549 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: [pid: 117838|app: 0|req: 603/1252] 10.222.0.17 () {58 vars in 1236 bytes} [Sat Aug 6 14:51:17 2022] GET /compute/v2.1/servers/20d7f033-8d80-4f4c-89d4-76d92081a555 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 06 14:51:18.430297 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: DEBUG nova.api.openstack.wsgi [None req-5d5c7c65-df9d-4ca7-aee5-002d052a24fd tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] Calling method '.version_select at 0x7fbab5ce54c0>' {{(pid=117837) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 06 14:51:18.459113 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO nova.api.openstack.requestlog [None req-5d5c7c65-df9d-4ca7-aee5-002d052a24fd tempest-TestVolumeBootPattern-1969510220 tempest-TestVolumeBootPattern-1969510220-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-603286594" status: 202 len: 0 microversion: 2.1 time: 0.032505 Aug 06 14:51:18.463638 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: [pid: 117837|app: 0|req: 650/1253] 10.222.0.17 () {58 vars in 1260 bytes} [Sat Aug 6 14:51:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-603286594 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 06 14:51:34.479003 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 14:51:34.479574 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Sat Aug 6 14:51:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 14:51:57.932132 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 14:51:57.932664 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Sat Aug 6 14:51:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 14:53:23.194926 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 14:53:23.195678 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Sat Aug 6 14:53:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 14:53:28.691077 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 14:53:28.691689 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Sat Aug 6 14:53:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 14:53:29.243409 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 14:53:29.243899 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Sat Aug 6 14:53:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 14:54:06.897391 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 14:54:06.898063 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Sat Aug 6 14:54:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 14:54:54.487080 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 14:54:54.487810 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Sat Aug 6 14:54:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 14:55:17.940714 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 14:55:17.941180 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Sat Aug 6 14:55:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 14:56:43.203083 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 14:56:43.203748 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Sat Aug 6 14:56:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 14:56:48.700453 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 14:56:48.701115 dv-cinder-851996-4-iscsi devstack@n-api.service[117837]: Sat Aug 6 14:56:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 06 14:56:49.252768 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 06 14:56:49.253334 dv-cinder-851996-4-iscsi devstack@n-api.service[117838]: Sat Aug 6 14:56:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!